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1. INTRODUCTION 


The pilot's task in the operation of flight vehicles is a 
complex of control and decision tasks. Models for predicting 
pilot performance and limitations must take into account the ef- 
fects of interaction among several such tasks. For the past few 
years we have been conducting a series of experimental and theo- 
retical studies of these interactive effects as part of a contin- 
uing program to develop models for human performance in realistic 
flight situations. This report describes our most recent work on 
this problem which has been concerned with the interaction or in- 
terference among several different control tasks. 

INITIAL TWO-AXIS STUDIES 

We began this work with studies of simple two-axis control 
systems without coupling between axes. Integrated and separate 
displays, several different controlled element dynamics, and 
foveal and peripheral viewing of the displays were examined in 
these studies. The theoretical basis for this work was provided 
by the describing function models for the human operator available 
at that time (Refs. 1,2). These had been developed by several in- 
vestigators over a ten-year period from studies of single axis 
control systems. Our approach was to attempt to elaborate these 
models so that they would include the effects of interference 
between tasks, visual scanning of displays, and the effects of 
viewing conditions (foveal vs. peripheral). The results of these 
studies have been reported and documented (Refs. 3 >4) and are 
summarized below. 
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In the experiment? with an integrated display, one in which 
the horizontal and vertical displacement of a single dot indicated 
the errors in the two axes , we found that the human controller 
transmitted almost twice as much information in certain two-axis 
tasks — those in which the dynamics on the two axes are the same — 
as he did in a single-axis task. We did not find evidence in the 
describing function results of a switching mechanism such as would 
be expected if the controller were single-channel and switched his 
attention from one task to the other. This result suggested that 
the two channels were processed in parallel. 


To determine the extent to which these results were a conse- 
quence of the integrated display, a series of two-variable manual 
tracking experiments was next conducted in which subjects were re- 
quired to view two separated displays and operate two control de- 
vices to control the system. Performance was measured as a func- 
tion of the display separation, the forcing function bandwidth, 
the task difficulty, and the controlled-element dynamics. Human 
controller describing functions, eye movement distributions, and 
normalized mean-squared tracking error (NMSE) scores were obtained. 
Measurements were obtained when a single variable was viewed fov- 
eally, when a single variable was viewed peripherally, and when 
both variables were controlled simultaneously. 

A simple model was developed which accounted for most of the 
results of this experiment. The key assumption of this model was 
that the human controller acts as a two-channel processor of infor- 
mation: one channel processes information obtained foveally while 

the other simultaneously processes information obtained peripherally. 
There was assumed to be no coupling, or interference, between chan- 
nels. A switching mechanism was incorporated in the model to account 
for the switching of visual attention from one display to the other. 
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Although this model was able to reproduce with reasonable 
accuracy the effects of visual scanning upon system performance, 
it had at least two serious deficiencies. It lacked a scheme for 
predicting scanning behavior; system performance could be "pre- 
dicted" only for a pre-specified scan pattern. There was' no way 
to account for the performance degradation that was measured for 
certain cases in which the two displays were very close to each 
other so that they both were viewed foveally. It also became 
apparent that the describing function approach lacked sufficient 
generality to be the basis for an integrated model of complex 
control and decision tasks. We turned to modern control theory 
for a framework within which such tasks might be treated in a more 
straightforward manner. 

THEORETICAL FRAMEWORK 

Initial Optimal Control Theoretic Model 

An optimal control model for human control, monitoring, and 
scanning behavior was developed in a separate but related research 
program (Refs. 5,6). Preliminary analysis of this model indicated 
that it had sufficient scope to account for human behavior in a 
wide variety of simple and complex tasks. We have adopted this 
model as the starting point for the theoretical and experimental 
investigations of task interference that are described in this 
report. The principal features of the model are discussed below. 

A block diagram of the model is given in Fig. 1. The vehicle 
dynamics are assumed to be represented adequately by the linearized 
state equation 

x(t) = Ax(t) +Bu(t)+w(t) (1) 
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where x(t) is the vector which describes the state of the vehicle, 

u(t) a scalar control, and w(t) a vector of white driving noise 

* 

processes. The pilot does not, in general, observe all of the 
state variables, but is provided with pertinent system outputs 
y_(t) , given as 

y.(t) = C x(t) (2) 

The various psycho-physical limitations inherent in the 
human are represented by a lumped equivalent perceptual time delay 
x and a model for remnant (discussed below) consisting primarily 

of an equivalent observation noise vector r(t). A separate (white) 

£ # 

observation noise is associated with each displayed output y^(t). 

It is assumed that the overall control task is adequately re- 
flected in the human's choice of a control input u*(t) which mini- 
mizes a weighted sum of averaged state and control variances 

n 

J(u) = + r °u + g a l (3) 

i=l 1 


conditioned on £ (t) = y^(t-x) + r(t-x), the human's delayed, noisy 
observation of y^(t). 


If the external forcing functions are rational noise spectra of 
first order or higher, the resulting "input states" are incorpor- 
ated in the state vector x(t). 

x* 

In order to include the effects of visual scanning, statistics 
of the noises can be treated as time-varying. See Ref. 5. 
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Note that neuro-motor dynamics have not been included among 
the human's inherent limitations. However, included in J(u) is a 
cost which depends on control rate. This term can represent an 
actual cost on u(t) or it can be used to account indirectly for 
the physiological limitations on the rate at which a pilot effects 
control action. It can be shown that the inclusion of such a term 
results in a lag (often associated with the neuro-muscular system) 
being generated in the optimal controller. 

In order to model certain control situations adequately, we 
have found it necessary to include a motor noise term m(t) in ad- 
dition to the observation noise vector. This is helpful primarily 
when the input disturbance is not applied in parallel with the 
pilot's control signal. In this situation, motor noise serves to 
prevent the model from acquiring perfect knowledge of various 
system inputs or outputs which, in fact, are not known perfectly by 
the human. Use of motor noise here is strictly a mathematical 
convenience and does not imply that we are able to distinguish 
experimentally the various sources of remnant, which we cannot do 
at present. 

With the above assumptions, the human's control character- 
istics are determined by the solution of an optimal regulator 
problem with time-delay and observation noise. We have shown 
(Ref. 5) that the resultant optimal closed-loop system has the 
structure shown in Pig. 1. The pilot model consists of the cas- 
cade combination of a Kalman estimator, a least-mean-squared pre- 
dictor and a set of gains acting on £(t), the best estimate of 
the system state x(t). The lag factor t n depends on the choice 
of control rate weighting, g. The features that are unique to 
this model are its representation of human limitations and the 
resulting optimally compensating elements. 
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Since the optimal feedback controller is linear, the pilot 
can be represented in the frequency domain by a transfer function, 

u ( s ) = H(s)£(s) (4) 

Therefore, in a straightforward manner, one can predict human 
operator describing functions which are equivalent to those which 
could be measured in an experiment. Furthermore, the model allows 
us to predict the power spectrum (input and remnant related) of 
any system state, of any output, or of the human's control. Also 
available is a prediction of closed-loop performance in terms of 
the cost functional [Eq.(3)]. 

An Ob se rv atio n Noise Mo del for Controller Remnant 

Although early studies of the human controller tended to 
ignore the effects of controller remnant on system performance, 
remnant has begun to command an increasing amount of concern. 

Recent attempts have been made by others to relate system perform- 
ance to visual scanning behavior by appropriate treatment of the 
remnant process (Ref. 7), and we have found that an equivalent 
observation noise representation of remnant allows us to incorpor- 
ate a model for task interference into our optimal-control frame- 
work. Because an understanding of remnant is crucial to the theo- 
retical development pursued in this report, the pre-experimental 
model for controller remnant is reviewed below. This model was 
developed in a separate but related theoretical study and is dis- 
cussed in detail in Refs. 8 and 9. 

A number of multiplicative, or proportional, sources of human 
randomness were originally considered. Most of these processes were 
found to be indistinguishable in their effects on controller remnant 
and were therefore combined into a single noise process — an equiva- 
lent observation noise process. 
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Equivalent observation noise has been found to be a vector 
white noise process; i.e., each sensory input variable that the 
controller wishes to estimate is disturbed by white noise. The 
component noise processes are assumed to be linearly independent 
of each other and of the system forcing functions. When the dis- 
play is viewed foveally, the noise processes appear to scale with 
signal variances. This scale factor has been found to be inde- 
pendent of the amplitude and spectral shape of the displayed vari- 
able, independent of vehicle dynamics, and does not appear to de- 
pend on the quantity (i.e., position or velocity) that the control 
ler obtains from the display indicator. Foveal observation noise 
is thus given as 

H - P • (5) 

where R is the power density level of the injected white noise 
2 

vector, a v a matrix composed of the variances of the quantities 
*y 

displayed, and P is the power density level of a normative white 
noise process (which we shall refer to as the "noise ratio"). 

This observation noise model of remnant has been verified by exten 
sive analysis of single-axis manual control data. We have found 
the noise ratio P to be approximately -20 dB (i.e., 0.01 units of 
normalized power per rad/sec, defined over positive frequencies) 
and relatively independent of the control situation. In fact the 
only departure from a -20 dB observation noise that we have seen 
in a large number of experiments was obtained in one of the last 
experiments discussed in this report. We do not yet fully under- 
stand the reasons for this singular result. Nevertheless, the 
relative invariance of the observation noise level suggests to us 
that foveal remnant — at least under the idealized tracking condi- 
tions that we have investigated — arises from a central-processing 
type of disturbance common to all tracking tasks (such as time- 
variational disturbances of controller gain or time delay). The 
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potential correspondence of equivalent observation noise to 
central-processing noise forms the basis for our models of task 
interference and pilot workload. 

ORGANIZATION OF THE REPORT 

In the following section of this report we present a model 
for task interference. Model predictions are compared with ex- 
perimental results in the succeeding two sections: interference 
among independent tracking tasks is described in Section 3, 
whereas Section 4 is concerned with interference within a single 
axis of control. Our model for task interference leads to a 
metric for pilot workload which is discussed in Section 5. The 
major conclusions of this report are summarized in Section 6. 

The appendices provide details of experimental apparatus and pro- 
cedures as well as complete documentation of experimental results. 
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2. A MODEL FOR TASK INTERFERENCE 


Because the human being is inherently limited in the amount 
of physical and mental effort he can exert at any given time, his 
ability to perform psychomotor tasks will, in general, deteriorate 
as he is required to perform more and more tasks simultaneously. 
Some of our early experiments with two-axis systems showed evidence 
of task interference, as did the more recent studies of two- and 
four-axis systems described in this report. In order to provide 
a theoretical framework for the experimental results presented in 
the following sections of this report, we describe below a model 
for predicting interference among two or more continuous manual 
control tasks. Only central-processing sources of interference 
are considered; performance degradation associated with visual 
scanning or intermittent control activity are not treated at this 
time . 


Interference which results from limitations on the human's 
central-processing capability have been most commonly attributed 
to single-channel behavior; i.e., a single channel has been postu- 
lated which must selectively "attend" to the various sensory inputs 
(Ref. 10). Parallel-channel behavior has also been considered in 
the literature; a multiband filter theory, for example, has been 
postulated to account for the behavior of the human observer when 
detecting multiple auditory signals (Ref. 11). In our model de- 
velopment we consider the human controller also as a parallel- 
channel processor of information. 

The model for task interference Is based on the notion that 
the controller possesses a fixed amount of information-processing 
capacity that must be shared among the various tasks to be per- 
formed. The fraction of "capacity" allocated to a particular task 
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is related to the equivalent observation noise ratio associated 
with that task. This relationship provides a mechanism by which 
we can incorporate the model of capacity-sharing into the frame- 
work of the optimal-control model of human behavior. 

BASIC ASSUMPTIONS 

The model is founded on the following primary assumptions: 

(a) Multiple tasks are performed in parallel , not in sequence. 

(b) The controller has a relatively large fixed number, N, of 
"information-processing channels" to distribute among his various 
tasks. (c) Each of these channels is perturbed by a white, 

Gaussian noise process which is linearly uncorrelated with all 
other noise processes and with system variables. The noise levels 
are proportional to signal variance. 

There is some experimental basis for assuming parallel pro- 
cessing of tasks. Time-domain and frequency-domain analysis of 
our manual tracking data has consistently failed to show evidence 
that the controller time-shares among tasks. This does not rule 
out the possibility of a very rapid internal scanning mechanism. 

The scanning (i.e., sequential) model of information processing 
is not necessarily incompatible with the model of parallel pro- 
cessing, since in the limit of arbitrarily rapid scanning the two 
models appear to lead to the same results. 

The assumption of a fixed number of channels available for 
tracking and other tasks is another way of saying that the control- 
ler’s "channel capacity" is constant. Fortunately, we shall not 
have to determine N, nor shall we have to compute the noise ratio 
associated with each individual channel. The important point is 
that these numbers are assumed invariant. 
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The assumption of white noise processes which scale with 
signal variance is a direct extension of our model for controller 
remnant and is consistent with earlier psychophysical data which 
show that estimation errors tend to scale with the magnitude of 
the stimulus. 

For mathematical convenience we refer central processing 
sources of interference to the input and treat them as if they were 
perceptual sources of interference. Accordingly we consider inter- 
ference to occur between perceptual tasks. However, we assume 
that position and velocity information can be obtained from the 
same display indicator without interferring with each other. Thus 
we assign a perceptual task to each indicator provided on the dis- 
play rather than to each variable used by the controller. This 
assumption is justified by our previous results (Refs. 6 and 9) 
which indicate that the noise ratio associated with estimation of 
indicator position does not depend on whether or not the pilot 
must also estimate indicator velocity. The noise ratio associated 
with estimation of velocity is similarly invariant to the require- 
ment to estimate position. Thus, if the controller is provided with 
two single-axis tasks, each having a simple display of system error, 
then he must divide his capacity between the two displays (aside 
from any scanning behavior that might take place). Similarly, if 
the subject is provided with a single (but complex) axis of control 
and a display consisting, for example, of a pitch indicator and a 
position indicator, he must again divide his capacity between the 
two perceptual tasks of estimating pitch and estimating position. 

EQUIVALENT OBSERVATION NOISE FOR SINGLE- VARIABLE TASKS 

Let us consider a tracking task in which the subject is re- 
quired to estimate (primarily) a single variable. We shall derive 
an expression for equivalent observation noise which explicitly 
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shows the dependence of the noise level upon the number of central- 
processing channels assigned to the task. 

The flow of information is diagrammed in Fig. 2. The dis- 
played variable [x(t)] is corrupted by the noisy, N-channel per- 
captual pre-processor to yield the perceived variable [y ( t ) ] . 

Both x(t) and y(t) are presumed to have zero mean. The signal 
suffers a delay due to limitations of the pilot's neuro-motor 
system and is then processed by the pilot's equalizer to yield 
the control signal u(t). Since all sources of randomness have 
been reflected to the perceptual pre-processor, we need consider 
here only the relationship between y(t) and x(t). 

The output of the n^ information-processing channel is 

y n (t) = x ( t ) + r n (t) (6) 

where r (t) is a Gaussian white noise process, having power density 

lip 

level Q*cn, which is injected onto the n^ channel. (The "noise 
ratio" Q is the same for each channel.) Since all N channels are 
presumed to be allocated to this single task, the total output of 
the subject's perceptual pre-processor will be 

N N 

y(t) = ^P[x(t)+r n (t) ] = N x(t) + y^r n (t) (7) 

n=l n=l 


Noting the linear independence of the r (t), 
ing spectrum for the perceived variable: 


4> = N 2 $ + N a 2 Q 

yy xx x 


= N 2 0 + i a 2 Q] 

xx N x 


we compute the follow- 
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( 8 ) 




FIG. 2 FLOW OF INFORMATION THROUGH THE HUMAN CONTROLLER 
FOR A SINGLE-VARIABLE TRACKING SITUATION 




The noise-related portion of the spectrum $ may be referred 

y y 

to an equivalent observation noise process whose power density 
level is 


R 


(1) _ Q 2 _ 2 

- tt a._ - Fa. 


N 


o x 


( 9 ) 


where the constant, P Q replaces Q/N. The unity superscript indi- 
cates that this relation holds only when the task is performed 
alone. 


We have thus rederived the expression for equivalent observa- 
tion noise which we have found to represent controller remnant in 
a variety of single-axis control situations. In addition, we have 
now seen how the noise level relates to the number of "channels" 
devoted to the tracking task. This relationship is crucial to our 
model for task Interference, as shown below. 

Let us now consider a situation in which M perceptual tasks 

are performed in parallel. Since the N information channels must 

now be distributed among the M tasks, the subject will be able to 

devote only the fraction f^ M ^ of his channels to the m th task. 

m 

The equivalent observation noise is now given as 



Q _2 _ o „2 

f (M) x TTmT x * 
m m 


( 10 ) 


We thus show that the primary effect of requiring the subject to 
perform a multiplicity of tasks is to increase the effective ob- 
servation noise ratio associated with each component task. The 

+■ 

observation noise ratio for the nr task when M tasks are performed 
simultaneously is simply 
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( 11 ) 


p (M) = p /f (M) 
m o m 


Transformation of this equation yields 

f (M) = p / p (M) 
m o' m 


( 12 ) 


Equation (11) represents a predictive model for task inter- 
ference. Given that we know the observation noise ratio P that 

o 

corresponds to "full capacity", we can predict the increase in 
noise ratio associated with each displayed variable for a particu- 
lar distribution of channel capacity. The optimal control model 
then allows us to predict the performance measures that accompany 
this distribution of capacity. Conversely, we can compute the 
fraction of capacity devoted to a given subtask when multiple, 
independent, tasks are performed in parallel. Provided that the 
subtask consists of a tracking task requiring a single displayed 
variable, we can readily measure the observation noise ratio under 
single-axis and multi-axis conditions. Equation (12) shows that 
the fraction of capacity associated with this task is given by the 
ratio of the single-axis to multi-axis observation noise ratio. 

PREDICTION OF MULTIVARIABLE TRACKING PERFORMANCE 

We now combine the model for task interference developed 
above with our optimal-control model for human performance to ob- 
tain a model for multi-task performance. The following computa- 
tional procedure may be used to predict overall system performance 
and pilot behavior in a multivariable control situation in which 
the pilot's goal is to minimize a quadratic, total-task performance 
measure of the form given in Eq . (3): 
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a. Find the set of parameters for the optimal-control model 
of human behavior which best reproduces the controller's single- 
axis behavior. This is a "calibration" procedure which allows one 
to determine the observation noise ratio that corresponds to full 
capacity, as well as to determine other basic parameters such as 
controller time delay, subjective cost functional, and, in the 
case of peripheral tracking, additional internal noise processes 
related to peripheral viewing. 

b. Compute the total performance cost as a function of the 
distribution of capacity among the displayed variables, where the 
fraction of capacity assigned to a given indicator is reflected by 
an increase in observation noise in accordance with Eq . (11). 

Since the total capacity must remain fixed, readjustments of the 
various observation noise ratios must meet the constraint 

M M p 

I>m M> ' E ;rm- = 1 (l3> 

m=l m=l m 

c. Select the capacity distribution that yields the minimum 
total performance cost. Under the assumption that the subject has 
been given sufficient training to learn the optimal distribution 
of capacity, the minimum cost is then the predicted cost. If the 
total task comprises a set of independent subtasks, pilot behavior 
and system performance for each subtask may be computed on the 
basis of the observation noise ratios associated with the corre- 
sponding displays. The amount of "interference" occuring on a 
given component task may be defined as the performance measure 
(score) predicted for that task in the M-task situation minus the 
score when the task is performed alone. 
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The model for task interference is validated against experi- 
mental data in the following two sections of this report. In 
Section 3 we consider interference among independent axes of control 
when two or four axes are controlled simultaneously. Interference 
between two display indicators related to a single axis of control 
is illustrated in Section 4. 


19 




3. INTERFERENCE AMONG INDEPENDENT AXES OF CONTROL 


In this section we compare data obtained from several two- 
and four-axis manual control experiments with predictions obtained 
from the model for task interference. The experimental and anal- 
ytical procedures used in obtaining these data are described in 
detail in Appendix A, and a complete presentation of the experi- 
mental results is given in Appendix B. We shall consider here 
only those experiments which relate directly to the study of 
central-processing sources of task interference. 

EXPERIMENTAL CONDITIONS 

The subjects were provided with the four-axis display config- 
uration shown in Pig. 3. Each component display consisted of a 
moving error bar and a stationary reference line presented on an 
oscilloscope. This configuration provided four viewing conditions 
(a) foveal, (b) 16° peripheral with reference extrapolation pos- 
sible — as, for example, when fixating the upper left display and 
tracking a signal on the upper right, (c) 16° peripheral with no 
reference extrapolation possible, and (d) 22° peripheral also with 
no reference extrapolation. Since the stationary reference line 
became imperceptible a few seconds after peripheral viewing was 
initiated, the subject's tracking performance was appreciably en- 
hanced whenever he could extrapolate the zero reference from his 
fixation point to the peripheral display. 

A single display was fixated during the entire run length, 
and two or more axes were controlled simultaneously. Each display 
used in a given multiaxis experiment was also tracked singly to 
provide a set of baseline measures to allow each subject to serve 
as his own control. Two two-axis manipulators were provided — one 
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FIG. 3 


DISPLAY CONFIGURATION USED IN THE EXPE 
Dimensions Shown in Degrees of Visual 


RIMENTS 

Arc 
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controlled by each hand — in order to provide control-display 
compatibility. Velocity control was provided on each axis, and 
each input signal was constructed from a number of sinusoidal com- 
ponents chosen to simulate a first-order noise process having a 
break frequency at 2 rad/sec. The input was applied in parallel 
with the controller's output (i.e., as a disturbance on vehicle 
velocity). Different input waveforms were used on each axis so 
that the subject would perceive no linear correlations among the 
inputs. The subjects — all of them instrumented-rated aircraft 
pilots — were instructed to minimize mean-squared system error 
when performing a single task and to minimize the sum of the com- 
ponent MS error scores when tracking multiple axes. 

POUR-AXIS TRACKING: ONE FOVEAL AND THREE PERIPHERAL AXES 

We first analyze the results of an experiment in which the 
•subjects were required to fixate the upper left display while 
tracking all displays simultaneously. No attempt was made to 
equalize the component task difficulties. On the contrary, since 
all four input signals were statistically identical, the component 
task difficulty (in terms of the error score) increased with de- 
creasingly favorable viewing conditions. In order to obtain mea- 
sures that were most likely to be representative of subject be- 
havior in general, and also to conserve modelling effort, the per- 
formance measures of the four subjects were averaged together for 
comparison with model predictions. The various performance mea- 
sures were averaged in a way that was both convenient and intern- 

* 

ally consistent: we computed a geometric average of the error 

variance scores along with algebraic averages of the normalized 
observation noise spectra (in dB), controller amplitude ratio (in 
dB) , and controller phase shift (in degrees). 

* f N 

We define the "geometric average" of the variable (x) as IT (x. ) 

Li-l - 
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The model parameters of relative weighting on control-rate 
variance, time delay, and observation noise ratio were adjusted 
to provide a good match between model output and single-axis foveal 
tracking results. The cost weighting on error variance was set to 
unity, and all other variables (except rate of control output) were 
given zero weighting in the cost functional. The motor noise vari- 
ance was set at a low enough level so as to have a negligible ef- 
fect on the model's output. The relative weighting on control rate 
was 0.0002, which introduced an effective lag time constant of 
0.0841 seconds. A time delay of 0.17 seconds and an observation 
noise ratio of -21.0 dB were found to provide a good match. This 
observation noise ratio, therefore, was selected as the ratio rep- 
resenting "full attention" to the task. 

Our criterion for a "good" match was that the predicted and 
measured error scores agree to within 10$, and the normalized ob- 
servation noise spectra and controller amplitude ratios generally 
match to within 2 dB. (When the above requirements were met, the 
predicted and measured phase shifts generally agreed to within 10 
degrees at mid-frequencies.) We did not attempt to match the error 
rate or control-related scores; the predicted values of these 
quantities tended to be on the order of 15 to 30 percent less than 
the measured values. Note that our primary concern here was to 
choose model parameters such that changes in model behavior corre- 
sponding to increased observation noise would be representative 
of the single-axis, multi-axis differences in controller behavior. 
We did not feel that it was necessary to match every detail of 
controller behavior to achieve this goal. 

It was necessary to extend our model for equivalent observa- 
tion noise to account for the effects of peripheral viewing on 
single-axis tracking performance. Since the single-axis experi- 
mental results (described fully in Appendix B) indicated that the 


I 


peripheral observation process was not proportional to signal vari- 
ance, we adopted the following simple model to account for peri- 
pheral viewing effects : 

R = (a 2 +o^) • P Q (14) 

p 

where a is the effective (vector) variance of an internal noise 
P 2 

process and represents peripheral threshold effects. a p is assumed 

to be invariant with respect to the variance of the displayed sig- 

2 

nal a , but it will depend on display location and orientation. 

P o is the noise ratio when full attention is devoted to the display 
The peripheral vector variance has two components associated with 
each indicator — effective thresholds for position and rate — which 
are not assumed necessarily to have the same functional dependency 
on display parameters. 

2 

In order to quantify the components of a p for each of the 

three peripheral viewing conditions that we used, the control-rate 

weighting, time delay, and observation noise ratio were kept at 

their nominal (foveal) values, and the peripheral noise variances 

were adjusted to match the single-axis peripheral measures. Table 

1 shows the parameter values that were found to match the 1-axis 

data corresponding to the four viewing conditions. Comparisons of 

measured and "predicted" single-axis normalized observation noise 
* 

spectra and controller describing functions are given in Pigs. 

4-7. 


Since we cannot measure the two component spectra of the vector 
observation noise process r(t), we have reflected controller rem- 
nant to an equivalent scalar noise process injected onto system 
error. See Appendix A for details of the computational procedure. 
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TABLE 1 


Model Parameters to Match Single-Axis Measurements 


Parameter 

Viewing Conditions 

Foveal 

l6°Periph 
Ref Ext 

l6°Periph 
No Ref Ext 

22° Periph 
No Ref Ext 

Time Delay x(sec) 


.17 

.17 

.17 

Lag Factor T N (sec) 

.0841 

.0841 

.0841 

.0841 

Obs. Noise Ratio P Q (dB) 


-21.0 

-21.0 

-21.0 

Peripheral Error Variance 
a^(deg 2 ) 

0.0 

3-76 

7.62 

59.2 

Peripheral Error Rate 

2 2 
Variance a •([deg/sec] ) 
px 

0.0 

2.96 

1 

8.46 

i 

15.9 
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FIG. 4 SINGLE-AXIS FREQUENCY-DOMAIN MEASURES: FOVEAL VIEWING 
Average of 4 subjects, 2 trials/subject 
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FIG. 7 SINGLE-AXIS FREQUENCY- DOMAIN MEASURES: 

22° PERIPHERAL VIEWING WITHOUT REFERENCE 
EXTRAPOLATION 

Average of 4 subjects, 2 trials/subject 
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Once the four single-axis conditions had been matched, our 
next task was to compute the total-task performance as a function 
of the allocation of capacity. Since the total task consisted 
of four independent tracking tasks, this part of the analytical 
procedure was performed in two steps. First, the optimal-control 
model was analyzed with several values of observation noise ratio 
to predict for each axis the relationship between performance score 
(in this case, error variance) and fraction of capacity. The re- 
maining model parameters were kept fixed at the numerical values 
shown in Table 1. The predicted relationships are shown for the 
four viewing conditions in Fig. 8. Optimum four-axis performance 
was obtained by locating the operating point which yielded minimum 
total score — defined as the sum of the four component error vari- 
ance scores — subject to the constraint that the fractions of cap- 
acity sum to unity. 

Predicted and measured error variance scores are compared in 
Table 2. The 1-axis and 4-axis scores obtained from the manual 
control experiments are shown in Table 2a. Also shown are the 
ratios of the 4-axis to 1-axis scores for each viewing condition 
and for the total performance measure. Table 2b indicates the 
predicted optimum 4-axis performance: i.e., the performance cor- 
responding to the distribution of capacity that would yield the 
minimum total score. 
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ERROR VARIANCE (degrees 2 visual arc) 



13 10 7 3 0 


OBSERVATION NOISE INCREMENT (dB) 

FIG. 8 PREDICTED RELATIONSHIP BETWEEN ERROR VARIANCE 
AND FRACTIONAL ALLOCATION OF CAPACITY 
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TABLE 2 

Comparison of Measured and Predicted 
Error Variance Scores for 4-Axis Experiment 


Measurement Viewing Condition Total 

Poveal 16° Periph 16° Periph I 22° Periph Score 
Ref Ext No Ref Ext No Ref Ext 


(a) Measured 


1-axis 

4-axis 

Ratio 


.11 

.27 

2.5 


42 

.9 

3 

1.6 

0 

1.7 



1-axis 

(b) Predicted: 

4-axis 

Optimal Behavior 

Ratio 


Fract. Cap. 


Noise Ratio 


- 15.0 


(c) Predicted: 
Best Match 
of Subjects' 
Behavior 


1-axis 

4-axis 

Ratio 

Fract. Cap. 
Noise Ratio 


.11 

.27 

2.5 

.20 

-14 . 0 


Error score in deg visual arc 
Average of 4 subjects, 2 trials/subject 















Since the subjects were not instructed as to how to apportion 
the total error among the component scores, the most critical test 
of the interference model is its ability to predict total score. 
Table 2 shows that the predicted total performance score was within 
3 % of the measured score. The model predicts less well the per- 
formance on the component axes. The subjects achieved lower scores 
on the foveal and 22° peripheral tasks than the model would predict, 
whereas experimental scores were greater than predicted on the axes 
corresponding to 16° peripheral viewing. These results suggest that 
the subjects "traded" performance on one pair of component tasks for 
performance on the remaining two with little degradation in total 
performance . 

The predicted fractions of capacity allocated to each compon- 
ent task are shown in Table 2b. Also shown are the corresponding 
observation noise ratios. The trend of the model predictions 
agrees with our intuitive expectations; the predicted fractions of 
capacity ranged from 0.10 for the foveal task to 0.45 for the 22° 
peripheral task. 

Since the subjects’ allocation of capacity was apparently dif- 
ferent from that predicted by the model, a simple model-matching 
procedure was used to determine the actual allocation of capacity. 
The curves of Pig. 8 were used to associate a fraction of capacity 
with the error variance score obtained on each axis when the four 

axes were controlled together. The results of this procedure are 

* 

given in Table 2c. The fractional capacities obtained by this 
procedure were not subject to the constraint that they sum to unity; 
nevertheless, we note in Table 2c that the sum of the fractional 


Because we quantized our model results to the nearest integral 
multiple of 0.05 units of fractional capacity,. we could not match 
the four-axis score perfectly. Comparison of Table 2a and 2c 
shows, nevertheless, that matching errors were less than 10$. 
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capacities is, in fact, nearly unity. It appears, then, that 
the subjects were operating within the constraint of a total 
fixed capacity. 

Model predictions were obtained using the noise ratios shown 
in Table 2c in order to demonstrate that our model structure ac- 
counts for the kinds of 1-axis, 4-axis differences observed in 
the human controller’s frequency-domain measures. (Note that the 
describing functions and observation noise spectra were not matched 
by the procedure described above — only the error scores were 
matched.) Experimental and measured controller describing func- 
tions and normalized observation noise spectra are compared for 
each of the viewing conditions in Pigs. 9-12. 

The model predicted the important trends of the differences; 
namely, the increase in normalized observation noise level, the 
decrease in controller gain, and the slight increase in high- 
frequency phase lag as the number of axes tracked was increased 
from 1 to 4. The most noticeable discrepancy between predicted 
and measured trends was observed in the observation noise results. 
Whereas the experimental data show the 1-axis and 4-axis normalized 
spectra nearly coinciding at high frequencies, the model indicates 
that the 1-axis, 4-axis differences should be small at low fre- 
quencies and larger at high frequencies. We suspect that this 
discrepancy may have resulted partly from a greater reliance on 

rate information (relative to position information) than was 
$ 

optimal. That is, the subjects may have "traded" position infor- 
mation for rate information within a given axis of control, just 
as they apparently traded performance on one axis for performance 

on another, without appreciably affecting their total score. The 

_ 

In Ref. 9 we present a simple model for controller remnant which 
shows that the break frequency of the normalized observation noise 
spectrum, as well as the asymptotic low-frequency level, is determ- 
ined by the ratio of the controller's gain on rate information to 
his gain on position information. 
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FIG. 11 EFFECT OF NUMBER OF AXES TRACKED ON FREQUENCY-DOMAIN 
MEASURES: 16° PERIPHERAL VIEWING WITHOUT REFERENCE 
EXTRAPOLATION 

Average of 4 subjects, 2 trials/subject 
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high-frequency portions of the amplitude-ratio curves shown in 
Figs. 9-11 are consistently higher than those predicted by the 
model, which is consistent with the notion that the subjects were 
using somewhat more velocity information than predicted. 

TWO- AXIS TRACKING: ONE FOVEAL AND ONE PERIPHERAL TASK 

Model predictions are now compared with the results of a two- 
axis tracking experiment. Vehicle dynamics and forcing- function 
spectra were the same as for the four-axis task. For this experi- 
ment we adjusted the mean-squared inputs so that the foveal and 
peripheral tasks would be of approximately the same difficulty in 
terms of the single-axis mean-squared error score. 

The display configuration of Fig. 3 was used, but only two 
adjacent displays were active during a given tracking run. The 
subject was required to fixate a single display throughout the run 
and to track that display foveally as well as to track peripherally 
the display in the nearest clockwise position. Single-axis foveal 
and peripheral measurements were also obtained. The subject was 
thus always able to extrapolate a zero reference to the peripheral 
display in this experiment. All four pairs of displays were tracked 
in sequence. When the two displays were in the same horizontal 
plane, two hands were needed for control, whereas only one hand 
operating a two-axis manipulator was needed when the displays were 
in the same vertical plane. In order to eliminate a direct source 
of motor interference, we consider only those trials in which two 
hands were needed for control. 

Rather than recalibrate the model against the single-axis data 
obtained in this experiment, we used the single-axis results obtained 
in conjunction with the previous experiment to predict the two-axis 
total and component error scores. We assumed the model parameters 



were the same as for the four-axis experiment and that therefore 
the relationship between error variance and fraction of capacity 
was as shown in Fig. 8. The lower two curves of this figure were 
translated along the ordinate so that the scores corresponding to 
full capacity matched the single-axis foveal and peripheral error 
variance scores measured in this experiment. (A change in scale 
factor was needed primarily to account for the increased mean- 
squared disturbance input applied to the foveal axis, and second- 
arily for learning effects.) Since only two axes were tracked in 
this experiment, the model results were readily combined to pro- 
vide the curve of total error score versus the fraction of capacity 
on the foveal task shown in Fig. 13. The fractional distribution 
of capacity yielding the minimum total score was obtained from this 
curve . 

Predicted and measured error scores, along with the predicted 
allocation of capacity to the foveal axis, are shown in Table 3- 
As is the case with the 4-axis results, the predicted total score 
is extremely close to the measured total score — a difference of 
less than 2 percent. The foveal and peripheral components of the 
score were also predicted reasonably well. Since differences be- 
tween measured and predicted component scores were no larger than 
10 percent, we did not attempt to achieve a finer match to the 2- 
axis results. The model predicted a capacity distribution of 50 
percent to each axis. Figure 13 shows that the total performance 
score was relatively insensitive to distribution of capacity; the 
subjects could have allocated up to 60 percent of their capacity 
to one axis or the other without increasing their total score by 
more than 5 percent above the predicted minimum. 
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TOTAL ERROR VARIANCE (degrees 2 visual arc) 



FRACTION OF CAPACITY TO FOVEAL-AXIS 


FIG. 13 PREDICTED RELATIONSHIP BETWEEN TOTAL 

ERROR VARIANCE AND FRACTION OF CAPACITY 
ON FOVEAL TASK: TWO-AXIS TRACKING 
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TABLE 3 


Comparison of Measured and Predicted Error Variance 
Scores for the Two-Axis Task: Two-Handed Control Only 


Measurement 

Viewing 

Condition 

Total 


Poveal 

l6°Periph 
Ref Ext 

Score 


1-axis 

.35 

■=T 

CM 

CO 

in 

• 

Measured 

2-axis 

.44 

C\J 

.87 


Ratio 

1.3 

CO 

H 

1.5 


1-axis 

.35 

.24 

.58 


2-axis 

.48 

.39 

OO 

Predicted 

Ratio 

1.4 

1.6 

1.5 


Pract. Cap. 

.50 

.50 

1.0 


Noise Ratio (dB) 

o 

OO 

r— 1 

O 

CO 
1 — 1 
1 

— 


2 

Error score in deg visual arc 
Average of 4 subjects, 4 trials/subject 
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TWO- AXIS TRACKING: TWO FOVEAL TASKS 


The model for task interference also accounts for interference 
observed in one of our earlier two-axis experiments (Ref. 4). In- 
dependent axes of K/s dynamics were used in this experiment, also. 
Each input signal (which was applied as a command signal rather 
than a vehicle disturbance) was composed of sinusoids designed to 
simulate a rectangular spectrum having a bandwidth of 2 rad/sec. 

In addition, a low-amplitude, high-frequency "shelf" was added to 
the input to provide measurements at high frequencies. Two error 
dots — one for each axis of tracking — were displayed to the sub- 
ject on a single oscilloscope. The dots moved in the vertical 
dimension, and their axes of travel were separated horizontally by 
about 0.8° visual arc. Since the diameter of the fovea is about 
2° visual arc, we assume that the dots were both viewed foveally 
most of the time. Separate controls were provided for each axis. 

Model parameters were first chosen to provide a good match to 

the single-axis experimental results. The observation noise ratio 

was then doubled to simulate an equal division of pilot capacity 

* 

between the two axes. A second-order Butterworth representation 
of the input spectrum was found adequate to yield a reasonably 
accurate prediction of controller behavior. Model parameters were 
chosen which were found to be typical of the subjects who partici- 
pated in this experiment: (a) the control-rate weighting: was 

chosen to yield an effective lag time constant of 0.084 sec, (b) 

time delay was set at 0.17 sec, and (c) an observation noise ratio 

# £ 

of -21 dB was adopted as the "full capacity" noise ratio. In 
■* 

Observation noise spectra were unavailable for the computation of 
capacity allocation. We therefore assume 50 percent capacity on 
each axis. As we have shown in the previous examples, total per- 
formance is relatively insensitive to capacity allocation. 

## 

The subjects used in this early experiment were the same ones who 
participated in the 4-axis experiment described earlier in this 
section. Hence, we use the same values for model parameters that 
we used to predict 4-axis performance. 



addition, a nonzero motor noise level was needed because the input 
was a command signal and not a disturbance applied in parallel with 
the pilot's control. This noise level was set at about -26 dB 
relative to control power to be consistent with motor noise levels 
used in matching earlier data obtained with command inputs (Ref. 6). 

Measured and predicted normalized mean-squared mean-squared- 
error scores, averaged across the two axes, are compared in Table 4. 
The predicted scores differed by less than 10$ from the measured 
scores. Most importantly, the predicted ratio of the 2-axis score 
to the 1-axis score (about 1.4) was very nearly that which was 
observed experimentally. Thus, the model for task interference 
accounts for the effect upon the performance score of adding the 
second axis of control. 


TABLE 4 

Effect of Number of Axes Tracked on Measured 
and Predicted Normalized Mean-Squared Error Scores 



Normalized Mean-Squared Error 

1-axis 

2-axis 

Ratio 

Measured 

.050 

.073 

1.45 

Predicted 

.047 

.065 

1.40 


Average of 4 subjects, 2 trials/subject 
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DISCUSSION OF THE INTERFERENCE MODEL 


A model for task interference has been described which is 
based on the notion that the human controller possesses a fixed 
amount of capacity which he allocates among the various tracking 
tasks to be performed. By relating allocation of capacity to 
changes in equivalent observation noise ratio, we have employed 
the optimal control model of human behavior to predict total-task 
performance scores very accurately. In addition, the effects of 
interference on controller describing functions and observation 
noise spectra are reasonably well predicted, although less accur- 
ately than the effect on total performance score. The ability to 
predict correctly the trends along all measurement dimensions sup- 
ports the assumption that interference effects can be related 
directly to a change in the observation noise ratio. 


The effects of task interference on measurements obtained from 
a given axis of control were, in general, less well predicted than 
the total performance measure (which was the only measure that the 
subjects were instructed to regulate). This lack of precision may 
have stemmed partly from an inadequate representation of the effects 
of peripheral viewing on observation noise. However, we suspect 
that the major source of error in predicting component-task perform- 
ance was the flexibility permitted in achieving near-optimum system 
performance. For example, studies performed with the model indi- 
cated that the total error score was relatively insensitive to al- 
location of pilot capacity about the nominal optimum. Similarly, 
we would expect a good flight control system to be somewhat insens- 
itive to details of the pilot's control and monitoring strategy. 

In general, the accuracy with which we can predict performance 
along a given measurement dimension should be related directly to 


46 



the precision with which the measured variable must be regulated 
in order to achieve the required overall system performance. 

A more serious limitation on the generality of our model for 
task interference is that we do not yet know how to predict what 
the pilot's total capacity (in terms of an equivalent observation 
noise ratio) will be in a given control situation. Although we 
have found single-axis noise ratios to be about -20 dB for control 
tasks involving stable vehicle dynamics, we show in the next sec- 
tion of this report that noise ratios as low as -26 dB were measured 
when the dynamics were unstable. (The subjects apparently were 
induced to achieve a particularly low noise level because of the 
high sensitivity of system performance to the observation noise 
ratio.) Until we understand better how the pilot's apparent capacity 
depends upon the nature of the control situation, single-variable 
"calibration" experiments will be necessary so that nominal model 
parameter values can be determined. We continue to assume, on the 
basis of our results, that the pilot's capacity remains fixed for 
a given type of control situation (and for a given level of pilot 
proficiency). 

Although model and experimental results are in good agreement, 
the phenomenon of task interference is clearly more complex than 
our model would indicate. For example, we show in Appendix B that 
two-axis interference is greater when a single two-axis manipulator 
is used than when two single-axis manipulators are employed. This 
result is suggestive of peripheral motor interference effects in 
addition to the central-processing interference that we have modelled. 
The near-perfect prediction of the total four-axis score is a bit 
surprising, then, when one considers that motor interference must 
have been present in this control situation. Apparently, there 
were compensating errors in our model structure (e.g., the subjects 
may have increased their total capacity in this very demanding 
control situation). 
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The data against which the model for interference has been 
tested have been obtained entirely from experiments in which the 
subjects were not allowed to scan visually. Although we have ob- 
tained a body of data relating to four-axis control with scanning 
permitted (see Appendix E) , we have not been able to model this 
situation properly. The current implementation of the optimal- 
control model does not now allow us to analyze the situation in 
which both scanning and task interference occur. This does not 
reflect a conceptual limitation on the interference model, however. 
Consideration of observation noise processes whose statistics vary 
with time in accordance with the subject’s fixation point (see 
Ref. 5) should enable the optimal-control model to yield predic- 
tions of pilot behavior which include the effects both of visual 
scanning and of central-processing limitations. Further develop- 
ment of the optimal-control model will be necessary before this 
capability is realized. 

Since modern aircraft displays are tending to place multiple 
display elements in close proximity to one another, our ability to 
predict the performance of such flight-control systems may depend 
increasingly less upon our ability to predict scanning behavior 
and more upon the accuracy with which we can predict mutual inter- 
ference among elements viewed foveally. We have shown that our 
model for task interference accounts for interference between two 
linearly independent, foveal displays. The experiment described 
in the following section of this report deals with the nature of 
interference between two highly coupled display elements. 
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4. INTERFERENCE WITHIN A SINGLE AXIS OF CONTROL 


One of the assumptions underlying the model for task interfer- 
ence described in Section 2 is that central sources of interference 
can be treated as perturbations of the equivalent observation noise. 
When system state information is to be presented visually, we assume 
that interference occurs among the display indicators viewed by the 
pilot. In the preceding section of this report we showed that the 
interference model provided reasonably good predictions of the ef- 
fects of interference for a set of multi-axis control situations 
in which there were no linear correlations among the display Indi- 
cators. In this section we discuss experiments conducted to deter- 
mine whether or not the model also applies when the displayed vari- 
ables are highly correlated. Our experimental strategy was similar 
to that described previously: (a) a set of single-variable calibra- 

tion trials was run to determine nominal values for model parameters 

(b) manual control data were obtained using two indicators, and 

(c) model predictions were compared with experimental data to deter- 
mine the nature of the interference. 

EXPERIMENTAL CONDITIONS 

The basic experimental apparatus and analytical tools described 
in Appendix A were employed in this experiment. The specific experi 
mental design is described below. 

The subjects were required to control dynamics of the form 

= K 
s (s-1) 


V 


(15) 



2 

where K was set to 1.0 degrees visual arc per second per newton 
of control force. These dynamics were implemented as the cascade 
of two subsystems K 1 /s and K^/Cs-l), as shown in Fig. 14. Two 
display conditions were investigated. For half the training and 
data trails, only the system error x(t) was displayed; both x(t) 
and the auxiliary signal y(t) (the output of the first subsystem) 
were displayed for the remaining trials. Numerical values for the 
experimental parameters shown in Fig. 14 are tabulated in Table 5- 


TABLE 5 

Experimental Units and Parameter Values for the First Experiment 


Parameter 

Units 

Value 

i (t ) 

volts 

(variable ) 

u(t) 

newtons 

(variable ) 

x(t) 

degree visual arc 

(variable) 

y (t ) 

degree visual arc 

(variable) 

z(t) 

volts 

(variable ) 

K 1 

(arc-degree/sec/volt 

0.20 

K 2 

(degree/sec )/degree 

2.50 

K I 

( dimensionless ) 

0.157 

K u 

volts/hewton 

2.00 

V K r K 2 

p 

(degree/sec )/newton 

1.00 

4 

2 

volts 

87.2 
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The vehicle dynamics shown in Eq. (15) were selected for this 
experiment for two reasons. First, the system was controllable 
when x(t) was displayed alone. An experiment could therefore be 
performed to determine pilot (i.e., model) parameters of time delay, 
subjective weighting, and observation noise ratio with the subjects 
controlling the same system that they would have in the multi- 
indicator situation. Our ability to perform this kind of calibra- 
tion experiment was crucial to the test of our model for interfer- 
ence. Second, preliminary model analysis indicated that performance 
would be considerably enhanced if there were no interference between 
the subject's perception of x(t) and his perception of y(t). We 
thus could expect a sensitive test of the interference hypothesis. 

Figure 15 shows the display format used when both x(t) and y(t) 
were displayed. These two quantities were presented electronically 
as two bars of light. The zero reference was identified by two 
short segments of tape placed on the horizontal axis of the 'scope 
face. We were initially uncertain of the appropriate format for 
displaying x(t) alone. In order to provide a consistent zero ref- 
erence throughout this experiment, we desired to blank the Y indi- 
cator when y(t) was not displayed. On the other hand, consistency 
with previous experiments dictated that the Y indicator be displayed 
as an auxiliary zero reference. Since we did not know whether or 
not performance would be significantly affected by the presence or 
absence of the auxiliary zero reference, half of the x(t)-alone 
trials were conducted with each of these two display formats. 

The input forcing function consisted of a simulated first- 
order noise spectrum having a break frequency of 2 rad/sec, as 
described in Appendix A. Input parameters shown in Table A-3 were 
used for this experiment. The input was applied as a vehicle dis- 
turbance, essentially in parallel with the pilot's control as shown 
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in Fig. 14. The input variance was chosen to provide an rms error 
for the single-indicator display situation that was approximately 
equal to the rms errors obtained in previous experiments (between 
0.25 and 0.5 degrees visual arc). 

Subjects were provided mixed training on the various display 
conditions throughout the training period, and a balanced experi- 
mental design was used. Half of the training and data trials were 
conducted with y(t) displayed. The subjects were instructed to 
minimize the mean-squared system error signal x(t) at all times. 
They were not told how to use the auxiliary signal y(t), nor were 
they assured that the latter signal would necessarily aid in their 
control of the signal. 

Since the subjects who had participated in the first experi- 
mental program were transferred out of our locality during the in- 
terval between the two experimental programs, a new set of four 
subjects were used for this program. Two of the subjects (JM and 
KG) were helicopter pilots currently active in the Naval Reserves; 
the remaining two (WM and WR) were commercial instructors. All 
pilots had instrument ratings, and none (except for JM) had parti- 
cipated in previous experimental programs with us. 

EXPERIMENTAL RESULTS 

The results of the single-axis, multivariable experiments are 
presented in this section. Average results of four subjects are 
given here; performance measures for individual subjects are in 
Appendix D. A subsequent experiment, conducted to confirm the very 
low observation noise ratios obtained in this experiment, is dis- 
cussed in Appendix C. 
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Validation of Interference Model 


Model parameters were selected to provide a "good match" (as 

defined in the preceding section of this report) to the experimental 

data obtained with the single-indicator display. The relative cost 

_e; 

weighting on control rate was found to be 7*5 x 10 , which produced 

a lag time constant of about 0.093 seconds in the controller's 
describing function. Controller time delay was 0.20 sec, and the 

observation and motor noise ratios were, respectively, -26.0 and 

* , 

-29.5 dB, An observation noise ratio of -26 dB was thus associated 

with full pilot capacity for this experiment. 

Predicted and measured human controller describing functions 
and normalized observation noise spectra for the X-only display 
condition are shown in Fig. 16 . (Since the subject's primary per- 
ceptual task was to estimate indicator velocity, remnant was 
reflected to a scalar noise process injected onto error rate and 
normalized with respect to error-rate variance.) Except for the 
measurements at the ends of the frequency range shown, the measured 
and predicted amplitude ratios and noise spectra agreed to within 
about 1 dB, and the phase-shift was matched to within 10 degrees over 
most of this range. 

Once the model was calibrated in this manner, we then tested 
it against two hypotheses: (a) no interference, and (b) full inter- 

ference between the perceptual tasks of estimating x(t) and y(t). 

In terms of model parameters, "no interference" implied observation 
noise ratios of -26 dB associated with the variables x(t), x(t), 
y(t), and y(t); other model parameters were held constant. The 


Note that motor noise was not assumed to be negligible. We found 
that a substantial motor noise level was needed to match the data 
obtained in one of the subsequent experiments (see Appendix C). 
Since we do not yet fully understand the relation between motor 
noise and the various parameters of the control situation, we 
selected the minimum motor noise ratio that would provide a good 
match to all the conditions studied in this experimental program. 
Once chosen, this noise ratio was held fixed for all conditions. 

54 


(ap) (ap) |(m)H| (6ap) (m)H7 


a. Normalized Observation Noise Spectrum 


. . -I r ■ i i — — 

b. Controller Describing Function 


-400 * 1 1 — 

0.05 0.1 0.2 


MEASURED 

MODEL 


0.5 1.0 


10 20 


FREQUENCY (rad/sec) 


FIG. 16 COMPARISON OF MEASURED AND PREDICTED FREQUENCY-DOMAIN 
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hypothesis of full interference between the X and Y indicators 
implied that the noise ratios associated with the four perceived 
variables should increase so that the fixed capacity is shared 
between the two indicators. The allocation of capacity which 
minimized the system error variance was found and performance 
predictions were based on the associated observation noise ratios. 
(In order to minimize computational effort, capacity allocation 
was quantized to integral multiples of 0.1 per indicator.) 

Observation noise ratios corresponding to the no-interference 
and interference hypotheses are given in Table 6. Also shown in 
this table is the predicted distribution of pilot capacity: 70$ on 
the Y indicator, and only 30$ on X. 

Predicted and measured average variance scores are given in 

Table 7. (Scores for the individual subjects are shown in Table 

D-15 of Appendix D. ) Variance scores are tabulated for system 
2 2 

error [o ], system error rate [a*], the optionally-displayed sig- 

a A 

nal Eo„], control effort [o„ ], and the rate-of-change of control 

y 2 ^ 

effort [a^]. Also shown are the ratios of 2-indicator score to 
1-indicator score. Since the average scores obtained with the 
Y-indicator blanked differed by less than 5$ from the scores ob- 
tained with the Y-indicator serving as a zero reference, scores 
from these two conditions have been combined into the 1-indicator 
category . 

Performance was significantly improved by the explicit display 
of the signal y(t). Table 7a shows that the display-related scores 
were between 60 $ and 70$ of the corresponding scores achieved with 
a display of only x(t). The control-related scores changed to a 
lesser degree: control variance was reduced to about 85$ of its 

1-indicator value, and the control-rate variance decreased by only 
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TABLE 6 


Effect of Display Conditions on Observation Noise Ratios 


Indicators 

Assumption 

Derivation 

Observation 
Noise Ratios 

Distribution 
of Capacity 

P x 

p y 

X 

Y 

X 

— 

matched 

-26.0 

— 

1.0 

— 

X,Y 

no interference 

predicted 

-26.0 

o 

• 

VO 

CM 

1 

1.0 

1.0 

X,Y 

full interference 

predicted 

oo 

o 

CvJ 

1 

-24.5 

0.3 

0.7 

X,Y 

full interference 

matched 

1 

ro 

u> 

• 

oo 

-22.0 

0.6 

0.4 




TABLE 7 


Effect of Display Conditions on Average Performance Scores 


Indicators 

< 

•I 

4 

** 

4 

Fraction 

of 

Capacity 

deg 2 

(deg/sec ) d 

(deg) 2 

p 

newton 

p 

(new. /sec ) 

X 

y 


a. Experimental Data 


X 

x,y 

Ratio 

.23 

.14 

.62 

1.8 

1.3 

.69 

.33 

.23 

.69 

49 

41 

.84 

2.0 x 10 3 
1.8 x 10 3 
.94 

- 

— 

— 

b. Model: 

No Interference 






X 

.24 

2.0 

.35 

48 

2.2 x 10 3 

1.0 

— 

x,y 

.097 

.86 

.15 

26 

CO 

o 

(—1 

X 

1 — 1 

1 — 1 

1.0 

1.0 

Ratio 

.40 

.44 

.43 

.55 

.51 

— 

— 

c. Model: 

Full Interference (Predicted) 





X 

.24 

2.0 

.35 

48 

2.2 x 10 3 

1.0 

— 

x,y 

.16 

1.2 

.22 

33 

1.4 x 10 3 

0.3 

0.7 

Ratio 

.64 

.61 

.61 

.68 

.65 

— 

— 


d. Model: Full Interference (Matched) 


X 

.24 

2.0 

.35 

48 

2.2 x 10 3 

1.0 

— 

x,y 

.17 

1.4 

.24 

36 

1.6 x 10 3 

0.6 

0.4 

Ratio 

.69 

.69 

.69 

.75 

.73 

— 

— 


Geometric averages - of 4 subjects, 4 trials/subject 
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about 6 %. An analysis of variance of the system error score 
(Table D-16 of the Appendix D) indicates that: (a) the degree of 

improvement associated with the multiple display was, on the aver- 
age, statistically significant, and (b) the amount of improvement 
varied significantly among the subjects. 

Comparison of Tables 7b and 7c shows that the predictions 

based on the full-interference hypothesis were considerably more 

accurate than those based on the no-interference hypothesis. The 

2 

reduction of the a x score which accompanied the addition of the 

Y display indicator was predicted to within 5 % by the interference 

2 2 

model, and the predicted reductions of o* and a were in error by 

x y 

only about 12 %. The no-interference model, on the other hand, pre- 
dicted display-related scores for the 2-indicator task that were 
fully a third lower than those observed experimentally. The inter- 
ference model also yielded better predictions of the control and 
control-rate scores, although these agreed less well with the ex- 
perimental results than did the predictions of the display-related 
scores . 

In Pig. 17 the describing functions and noise spectra predicted 
by the interference model for the two display conditions are shown 
along with the experimental measurements. The corresponding noise 
ratios are listed in the first and third rows of Table 6, respec- 
tively. The model predicts a rather substantial change in the 
normalized observation noise spectrum as the Y display is added; 
the spectrum is shown to increase by 4 to 5 dB at low and mid fre- 
quencies, whereas the trend is reversed at high frequencies. Smaller 
changes are predicted for the describing function: the amplitude 

ratio (AR) corresponding to the 2-indicator condition is about 2 dB 
greater than that predicted for 1 indicator at low frequencies, the 
AR's coincide at frequencies near gain-crossover (around 5 rad/sec). 
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and a greater high-frequency peak is predicted for the 2-indicator 
curve. The model predicts negligible change of phase shift at low 
frequencies, whereas a substantial reduction of phase lag is pre- 
dicted at frequencies above gain-crossover. 

The prediction that the normalized observation noise spectrum 
will, on the average, increase when the Y indicator is added may 
come initially as a surprise, since the augmented display should 
provide better (and therefore less noisy) viewing conditions. 

Part of this increase is due to the normalization process, since 
the predicted error-rate variance is lower for the 2-indicator con- 
dition. At low frequencies the non-normalized observation noise 
spectrum for the 2-indicator display is still about 2 dB higher 
than that for the 1-indicator display, however. 

Power spectra of the portion of system error resulting from 
controller remnant are shown for the two displays in Fig. 18a. 

Note that the 2-indicator spectrum was higher at low frequencies 
than the 1-indicator spectrum, a result consistent with the obser- 
vation noise measurements . But the spectrum of the input-correlated 
portion of the error, presented in Fig. 18b , is lower for the 2- 
indicator display at low frequencies. Thus, the reduction of system 
error variance associated with the 2-indicator display results from 
the reduction of the input-correlated portion of the error spectrum, 
which in turn is produced by the higher controller amplitude ratio 
at low frequencies (Fig. 17). 

The predicted effects of display conditions on the frequency- 
domain measurements are only partially supported by the experimental 
results. Figure 17 shows that the addition of the Y indicator pro- 
duced no consistent or appreciable change in the measured normalized 
observation noise spectrum, as opposed to the appreciable change 
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predicted by the model. The controller describing function, on 
the other hand, was affected by the addition of the Y indicator 
in approximately the manner predicted by the model; the amplitude 
ratio increased at low frequencies, had a higher peak value at high 
frequencies, and was unchanged in the region of gain crossover; 
the phase lag was reduced somewhat at high frequencies. 

The appreciable discrepancy between the predicted observation 
noise differences and the lack of experimental verification requires 
further comment. We suspect that this discrepancy may be a mani- 
festation of the subjects' tendency to be slightly nonoptimal in 
their behavior so long as they achieve essentially the same overall 
system performance as they would if they had been truly optimal. 

The effect of distribution of capacity on predicted error variance 

p 

[o ] shown in Fig. 19 } for example, indicates a maximum variation 
of about 10 percent as the predicted fractional allocation of capa- 
city on the X indicator is varied from 0.2 to 0.6. Since the sub- 
jects were required to devote full attention to the X indicator for 
half their training runs, the mixed training procedure that we used 
may have induced the subjects to devote as much capacity as was 
feasible to the X indicator when both indicators were displayed. 

This behavior would be consistent with the multi-axis behavior that 
we noted in our earlier 4-axis experiments; namely, that the subjects 
apparently allocated more of their capacity to the more familiar 
foveal display than would have been optimal without suffering much 
degradation in the total error score. 

In an attempt to achieve a better match to the behavior of the 
subjects for the 2-indicator conditions, we assumed a capacity dis- 
tribution of 0.6 on the X indicator and 0.4 on Y. The corresponding 
observation noise ratios are shown in the bottom row of Table 6. 
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FIG. 19 EFFECT OF DISTRIBUTION OF PILOT CAPACITY 
ON PREDICTED ERROR VARIANCE SCORE 
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Table 7d shows that an additional 10% error was introduced in the 
? 

predicted a x score, but better predictions were obtained for the 
control-related scores. Figure 20 shows that the frequency-domain 
measurements were matched more closely; in particular, the discrep- 
ancy between model and measured normalized observation noise spec- 
trum was halved. 

Subjective Responses 

In an attempt to determine a correlation between the pilots' 
subjective impressions of task difficulty and objective measures 
of system performance, we required each subject to respond, in 
writing, to a questionnaire. When requested, in separate questions, 
to identify the display condition that was "easiest", "most prefer- 
able", and "best for doing the job", the four subjects unanimously 
chose the 2-indicator display. Although it is possible that the 
"subjective" opinions were partly based on the knowledge that lower 
error scores were achieved when the Y indicator was included in the 
display, several of the comments suggest that truly subjective im- 
pressions entered into their rating of the tasks. For example, two 
of the subjects commented to the effect that the Y indicator en- 
abled them to predict, to some extent, the movements of the X indi- 
cator (which was correct, since the position and rate of the Y 
indicator provided information, respectively, about the first and 
second derivatives of the X indicator). One subject volunteered 
the comment that more concentration was required for the X-only 
display because of its decreased informational content. On the con- 
trary, another subject felt that he worked harder when provided 
with two indicators precisely because more Information was available. 
The fact that all subjects gave the 2-indicator task the most 
favorable rating — despite inconsistencies in their reasons for 
so doing — correlates favorably with the notions of pilot workload 
that we present in the next section of this report. 


65 










I 


Valida tion of Observation Noise Results 

Although this experiment provided further validation of our 
model for task interference, we obtained one experimental result 
that was unexpected; namely, the very low observation noise ratio 
associated with "full capacity." The 1-indicator "calibration” 
experiment yielded a ratio of -26 dB, as compared with the -20 dB 
level we have observed in all previous attempts at matching model 
output to experimental data. Accordingly, a subsequent experiment 
was performed to investigate the cause of this unexpectedly low 
noise ratio. This experiment is discussed in Appendix C; the re- 
sults are summarized briefly below. 

In order to determine whether or not observation noise ratio 
was related in a consistent manner to the nature of the task, we 
required the subjects to perform three single-axis tracking tasks 
in alternation: (a) the unstable-vehicle , K/s (s-A ) , task investi- 

p 

gated in the experiment just discussed, (b) a K/s tracking task 
of the type investigated in earlier studies, and (c) an additional 

p 

K/s task. We found the noise ratios to be on the order of -25 dB 

for all three tasks. On the other hand, the optimal-control model 

indicated that the error score was most sensitive to observation 

noise ratio when the vehicle dynamics were unstable and least sen- 

2 

sitive when the previously-investigated K/s task was simulated. 

We conclude from these observations that training with the unstable 
vehicle dynamics motivated the subjects to achieve a lower observa- 
tion noise ratio than they would have achieved had they trained 
only with stable dynamics. Having trained thusly, they maintained 
the low noise ratio when the dynamics were more stable. 
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SUMMARY AND DISCUSSION 


An experiment was designed to enhance our understanding of 
central-processing sources of task interference in multivariable 
manual control situations. Four subjects were required to perform 
a single-axis control task with either one or two system variables 
shown explicitly on a single display. Comparison of model predic- 
tions with experimental results indicated that a significant amount 
of interference was present when two indicators were shown, and 
that this interference could be accounted for by assuming that a 
fixed amount of "pilot capacity" had to be shared between the two 
indicators. Although a straightforward application of our optimal 
control model enabled us to predict the total performance measure 
very well, detailed predictions of pilot behavior were less accur- 
ate. By assuming a slightly nonoptimal allocation of attention on 
the part of the pilot, however, we were able to achieve an acceptable 
match to the 2-indicator experimental data without violating the 
notion of a fixed capacity. 

Perhaps the most important result of this study was that our 
model for task interference correctly predicted the benefits of 
adding the second indicator to the display; that is, it predicted 
that the improvement in performance allowed by the additional in- 
formation would more than offset the performance degradation caused 
by interference between display indicators. Accordingly, we feel 
that the model for interference may prove useful in the design of 
complex displays for real flight-control situations, particularly 
with regard to determining the point at which increased display 
complexity no longer aids the pilot. 
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5. A METRIC FOR PILOT WORKLOAD 


In this section we define a metric for pilot workload and 
verify the reasonableness of this definition by a comparison of 
model predictions with pilot-opinion data and with other relevant 
experimental results reported in the literature. 

DEFINITION OF THE WORKLOAD INDEX 

The model of task interference discussed in Section 2 lends 
itself straightforwardly to the prediction of the amount of "work- 
load" associated with a given task. The assumption that the pilot 
possesses a fixed amount of channel capacity to be shared among 
his tasks forms the very basis for the concept of workload. If 
capacity were not limited in some manner, the pilot would be able 
to perform an unlimited number of tasks with no performance degra- 
dation; hence, there would be no "loading" of one task upon another 
It is clear, however, that the human is limited in the amount of 
work (either physical or mental) he can perform. 

We define the "workload index" (WI) as the fraction of the 
controller’s capacity that is required for him to perform a given 
task to some specified, or criterion, level of performance. This 
definition is consistent with those suggested by others in the past 
Senders, for example, has defined the workload of a visual monitor- 
ing task as the fraction of time required to fixate the associated 
instrument and has attempted to employ information-theoretic con- 
cepts to enable him to predict workload (Refs. 12 and 13). The 
primary difference between our current definition of workload and 
those suggested previously is the distinction we now draw between 
distribution of total channel capacity (which may be thought of as 
an internal "attentional-sharing" mechanism) and overt visual 
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"attention" as defined by the pilot’s fixation point. We have 
postulated a model of "central-processing workload," as distinct 
from "sensory workload" effects that arise when not all displays 
can be viewed foveally, or "motor workload" effects that would be 
present if the pilot had to time-share his hands among several 
manipulators. We are focussing upon central-processing workload 
because we wish to understand and predict interference effects 
between continuous control tasks and other kinds of flight tasks 
(such as conversation or auditory monitoring) that do not require 
the pilot to divert foveal attention from the flight displays. 
Furthermore, as head-up and multi-element displays are refined and 
put into practice, we suspect that central sources of task inter- 
ference will become more important. 

The workload metric suggested here — the fraction of capacity 
required for adequate performance — is one that we can predict 
quantitatively with the current implementation of our optimal- 
control model for human behavior. The procedure is similar to 
that used in Section 3 for predicting task interference: once the 
model is "calibrated" for single-axis behavior (either by doing a 
simple experiment or by using nominal values of parameters that 
have been found to match previous data), a curve of performance 
score versus observation noise ratio is obtained. By relating the 
observation noise ratio to fraction of capacity, as discussed in 
the preceding progress reports, a quantitative value of workload 
may be obtained. In terms of our model for the human controller, 
we may define the workload index alternately as 

WI = P o /P c (17) 

where P Q is the observation noise ratio corresponding to the pilot's 

"full capacity," and P is the maximum noise ratio that allows the 

c 
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pilot to achieve the required level of system performance. The 
noise level P o reflects not only the pilot's inherent limitations, 
but also his state of training. 

WORKLOAD INDEX AS A FUNCTION OF VEHICLE INSTABILITY 

Jex (Ref. 14) and McDonnell (Ref. 15) have reported manual 
control experiments using vehicle dynamics of the form K /(s-X) as 
a secondary tracking task. They found that main-task performance 
and pilot opinion degraded as X was increased. They concluded that 
the attentional demand of the secondary task increased as the in- 
stability increased, with the result that a decreasing fraction of 
pilot capacity remained for the primary task. If the connection 
between the unstable pole location and "attention" is correct, 
which we think it basically is, then our model should predict that 
the WI increases with increasing X. Accordingly, in order to verify 
the reasonableness of our definition of workload index, we have 
determined the relationship between predicted WI and vehicle in- 
stability . 

Since the WI is highly task-dependent, we had to specify not 
only the vehicle dynamics but the input spectrum, performance func- 
tional, and the criterion level of performance. The model was 
tested using a simulated first-order input spectrum having a break 
frequency of 2 rad/sec. The input was applied as a vehicle disturb- 
ance (i.e., in parallel with the control signal). The cost functional 

2 2 2 

was of the form J = o + G • a* where a is the variance of system 
2 x vi x 

error and the variance of control rate. 

Using nominal values of parameters that we have found to be 
representative of single-axis manual tracking performance with 
first-order vehicle dynamics, we adopted -20 dB as the observation 
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noise ratio corresponding to full capacity, fixed the effective 
time delay at 0.17 sec., and adjusted the relative weighting on 
control rate [G] to yield an effective lag time constant of approx- 
imately 0.1 sec. Motor noise was made negligibly small (on the 
order of -50 dB relative to the variance of the control signal). 
Curves of performance score versus observation noise ratio were 
obtained for X’s of 0.0, 0.5, 1.0, and 1.5 rad/sec. These curves, 
normalized to yield a performance score of unity for the 1/s, full- 
capacity condition, are shown in Fig. 21. For ease of interpreta- 
tion we have shown the abscissa as the fraction of pilot capacity, 
given as P 0 /P where P c is the nominal full-capacity ratio of -20 
dB and P is the actual noise ratio used in the model. 

The relationship between WI and vehicle instability depends 
upon the particular criterion level of performance chosen: the 

more stringent the criterion, the greater will be the workload 
index. The WI can be obtained from Fig. 21 by noting the inter- 
section of the performance-versus-noise-ratio curve with the cri- 
terion performance level. 

The relationship between workload index and vehicle instability 
is shown in Fig. 22 for various values of criterion performance 
level. The curves show the expected trends. The WI increases as 
the instability increases, and, for a given set of vehicle dynamics, 
the WI increases as the criterion score is reduced. Figure 22 
shows the trade-off between criterion and vehicle instability with 
respect to workload Index. For example, a WI of 0.2 is predicted 
for a vehicle pole of about 0.65 rad/sec and a criterion performance 
level of 5, or for a vehicle pole of about 1.1 rad/sec and a cri- 
terion level of 10. In other words, a constant level of subjective 


This theoretical study was completed before we discovered that a 
substantially lower noise ratio could be obtained by training the 
subjects with unstable vehicle dynamics. Nevertheless, we suspect 
the trends shown in this section are relatively independent of the 
particular choice of minimum noise ratio. 
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PERFORMANCE SCORE 


20 



FRACTION OF CAPACITY 


FIG. 21 PREDICTED RELATION BETWEEN PERFORMANCE SCORE 
AND FRACTION OF PILOT CAPACITY 
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CLE INSTABILITY 



task difficulty should be obtainable if the required level of per- 
formance is relaxed as the vehicle dynamics become correspondingly 
more difficult. 

The absolute value of the workload index is dependent not only 
upon the vehicle dynamics and the criterion performance level, but 
also upon the input spectrum, the cost functional, and the particu- 
lar values assigned to controller time delay and nominal observa- 
tion noise ratio. Consequently, some degree of arbitrariness will 
be associated with the WI predicted for a given task. We suspect 
that the WI will prove to be most useful as a measure of relative 
difficulty when two or more control configurations are considered. 
For example. Fig. 22 shows that the WI associated with a vehicle 
pole of 1.0 rad/sec will be about four times the index associated 
with a straight K/s plant for criterion performance levels ranging 
from 2 to 10. 

Although our definition of the workload index is primarily a 
definition of mental workload, our method of computing the index 
also includes the effects of physical work. Note that the cost 
functional used in the above computation includes a term related 
to control activity. An increase in the simulated control effort 
(as might be produced by a decrease in the vehicle gain K c ) would, 
for example, shift upwards the performance-versus-noise-ratio curves 
of Fig. 21. A decrease in control gain would thus be accompanied 
by an increasing WI. Examples of predicted workload index versus 
vehicle gain are given below. 

COMPARISON OF WORKLOAD INDEX WITH PILOT RATINGS 

If the workload index as we have defined it is a measure of 
the overall difficulty of a specific control task, we would expect 
to find a high degree of correlation between pilot opinion ratings 
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obtained in real or simulated flight situations and the WI pre- 
dicted by our model. McDonnell has recently reported a set of 
experimental results in which pilot ratings were obtained over a 
wide set of consistent experimental conditions (Ref. 15). We 
shall compare WI with the pilot ratings reported in that reference. 

McDonnell and others (Ref. 16 ) have noted strong relationships 
between pilot opinion and pilot parameters such as pilot gain and 
pilot equalization. The relationship between rating and effective 
pilot time delay appears to be less consistent. In addition to 
these considerations, McDonnell states that pilot opinion is also 
influenced by the relative ease with which mission requirements can 
be fulfilled. Consequently, the parameters of the disturbance func- 
tion and the required level of performance are important considera- 
tions . 

All of these factors are incorporated into our procedure for 
computing the workload index. Although we have defined the WI in 
terms of pilot capacity or attention, the performance-versus-capacity 
relationship used in computing the WI is itself a function of input 
and vehicle parameters. Since pilot parameters are also dependent 
upon input and vehicle parameters, we would expect to predict some 
correlation between workload index (and, therefore, pilot opinion) 
and pilot behavior. Note that we do not consider this as a cause 
and effect relationship. Since the pilot describing function is 
predicted by the optimal control model, both pilot behavior and WI 
are model outputs which are based on a common set of underlying 
factors. We show below that the predicted workload index Is ef- 
fected in the same way as pilot rating when changes occur in: 

(a) control gain, (b) pilot lead, and (c) system performance. 
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McDonnell's primary task was a single-axis compensatory track- 
ing task. A random-appearing command input was provided using a 
sum of sinusoids to simulate a rectangular spectrum with a low- 
amplitude, high-frequency shelf. Several vehicle dynamics were 
used, mostly of the form 


V(s) 


s (Ts+l) 


( 18 ) 


where T ranged from 0 (for K/s ) to infinity (for K/s 2 ). Pilot 
ratings were obtained for various values of input and vehicle 
parameters . 


In order to provide a reasonable approximation to McDonnell's 
forcing function without requiring excessive computational effort, 
the model was programmed to simulate a second-order Butterworth 
input having a break frequency of 1 rad/sec. With one exception, 
nominal model parameters were chosen as in the previous example: 
time delay was set at 0.17, "full-capacity" observation noise ratio 
at -20 dB, and the weighting on control rate was chosen to yield 
an effective pilot lag of 0.1 sec. The motor noise, however, was 
not made negligible, but was nominally set at around -27 dB rela- 
tive to control power. 


We cannot, at this stage in our thinking, expect to obtain a 
very close match between Cooper rating and predicted workload index. 
We do not yet understand fully how to choose the appropriate cost 
functional, nor are we sure of the best way to handle motor noise. 
Since McDonnell apparently did not specify the criterion level of 
performance for all tasks, our choice of a criterion level is arbi- 
trary. The value of the workload index, of course, depends upon 
all these parameters. In addition, we do not know the appropriate 
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functional relation between workload index and Cooper rating; for 
simplicity, we have assumed a linear relationship with a scale 
factor that seems to provide the best match on the average. Con- 
sequently, we must be content at this time with predicting the 
trend of the Cooper rating. As we show below, the trends are pre- 
dicted rather well. 

Effect of Control Gain 

McDonnell and others have found that there exists a broad 
range of control gain that the pilot finds acceptable. When the 
gain is either increased or decreased beyond this range, a less 
favorable rating is assigned to the system. 

In order to reproduce one of the conditions investigated by 
McDonnell, vehicle dynamics of K/s were simulated. The vehicle 
gain was first set to unity, and the control rate weighting and 
motor noise levels were found according to our procedure for choos- 
ing '’nominal" values. This condition was interpreted as the "opti- 
mal gain" condition. The effects of control gain on workload index 
were then investigated by keeping fixed the absolute (not relative) 
values of rate weighting and motor noise as vehicle gain was varied. 
A performance level of 5 times the "full-capacity" performance of 
the optimal-gain system was chosen as the performance criterion. 

Figure 23 compares predicted workload index and Cooper rating 
as a function of relative control gain. (A relative gain of unity 
indicates optimum control gain.) The pilot ratings were obtained 
from Fig. 20 of McDonnell (Ref. 15). Although the WI appears to be 
a more sensitive function of control gain than does the Cooper 
rating, the WI and rating exhibit the same trend: both increase 
numerically as the gain is either increased or decreased with 
respect to the "optimum gain." 
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Effects of Pilot Lead 


McDonnell manipulated the amount of lead generated by the 

pilot via adjustment of the vehicle lag term T when vehicle dynamics 

were K /s(Ts+l). He found that the pilot's lead coincided with ve- 
c 

hide lag for a lag time constant ranging from 0 to 1 second. For 

very large vehicle lags (i.e., for vehicle dynamics approaching 

2 

K/s ) he estimated the pilot lead time constant as 5 rad/sec. 

Vehicle gains were adjusted to be "optimal" for each vehicle con- 
figuration. 

Predicted workload indices were obtained from the optimal- 
control model using the nominal parameter values described above. 

A second-order Butterworth noise process having a break frequency 
of 1 rad/sec was assumed for a command input. A performance level 
of 5 times the full-capacity performance attainable with the K/s 
vehicle was chosen as the criterion level. 

The relationship between predicted WI and pilot rating versus 
pilot lead is shown in Fig. 2^4 . (Pilot ratings were obtained from 
Fig. 22 of Ref. 15.) Rather than attempt to estimate pilot lead 
by fitting the predicted describing function with the crossover 
model, we have simply assumed the same relationship between pilot 
lead and vehicle lag as McDonnell. Figure 2k shows that both WI 
and pilot ratings increase with increasing pilot lead. The pre- 
dicted WI shows a larger Increment between the two highest pilot 
lead conditions than does the pilot rating. McDonnell, however, 

notes that other researchers have found relatively large decrements 

2 

in rating associated with K/s vehicle dynamics. 

Effects of System Performance 

McDonnell points out that pilot opinion is partially dependent 
upon the overall performance of the man-vehicle system. He finds 
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FIG. 24 WORKLOAD INDEX AND PILOT RATING 
VERSUS PILOT LEAD 
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a reasonably consistent trend between normalized error score (given 
as the integral absolute efror divided by integral absolute input) 
and pilot rating. These data, obtained from Fig. 25 of Ref. 15, 
are shown below in Fig. 25. Also shown in that figure is the re- 
lationship between predicted WI and normalized error score, which 
was determined by reinterpreting the model results obtained in the 
previous example. A normalized model score of 2 • was found 

to provide a good match between predicted WI and pilot ratings as 
a function of system performance. (Predicted error scores were 
consistently lower than those achieved by McDonnell, possibly be- 
cause of input differences or because the experimental subjects may 
not have been trained sufficiently to reach near-optimal levels of 
performance.) 

SUMMARY AND DISCUSSION 

A metric for pilot workload — the "Workload Index" — has been 
defined as the fraction of pilot capacity (or attention) required to 
perform a given task to a criterion level of performance. By re- 
lating pilot capacity to the equivalent observation noise ratio, 
we have developed a procedure for predicting the workload index in 
a given control situation. 

We have seen that the predicted workload index increases with 
vehicle instability (provided other control system parameters re- 
main constant). Since vehicle instability has been shown to corre- 
spond to some extent to attentional demands on the pilot, these 
results support our approach of relating workload to attention. 
Further analysis has shown that the predicted workload index re- 
produces the trend of pilot ratings with respect to changes in: 

(a) control gain, (b) pilot lead, and (c) system performance. 

These results suggest that the workload index may serve as a use- 
ful indicator, or predictor, of aircraft flying qualities, as well 
as a measure of the demand on the pilot. 
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WORKLOAD INDEX 



FIG. 25 WORKLOAD INDEX AND PILOT RATING 
VERSUS SYSTEM PERFORMANCE 
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The workload Index, as presently defined, probably will serve 
best as a measure of relative , rather than absolute , Indication of 
the demand on the pilot (or of the vehicle handling quality). In 
order to derive an absolute metric, we would have to know the mini- 
mum noise ratio that can be achieved by a pilot under all circum- 
stances. We have seen that this noise ratio depends in part on the 
way the subject is trained. Furthermore, we suspect that the pilot 
never applies literally all his mental capacity to a tracking task. 

The workload index can be used to predict "trade-offs" among 
system parameters and between different tasks that leave the work- 
load index unchanged. We have observed such a parameter trade-off 

in a recent experiment (see Appendix C) in which the subjects, on 

p 

the average found a K/s and a K/s(s-l) task of about equal diffi- 
culty because of the way in which we manipulated the input power. 
Predictions of this type are possible because the workload index 
is affected by all of the parameters of the control system. In 
future studies we expect to investigate the relative workloads 
imposed by different kinds of tracking tasks and by other types 
of tasks (such as decision-making) as well. 



6. SUMMARY AND CONCLUSIONS 

The principal results of this study are the models for task 
interference and workload that we have developed from our optimal 
control model of the human controller. The model for task inter- 
ference has been tested sucessfully against a variety of experi- 
mental results described in this report. This model is based on 
the assumption that multiple tasks are performed in parallel and 
that a fixed amount of central-processing capacity must be shared 
among the tasks. The most consistent results are obtained if we 
associate a separate "task" with each display indicator that the 
pilot uses (not necessarily with each variable observed, since we 
find that there appears to be no interference between estimations 
of position and rate of a single indicator). 

The model for interference can treat display indicators that 
are linearly related (coupled) as well as uncoupled indicators; 
i.e., the same rules apply for multi-axis control situations as 
for single-axis, multi-variable tasks. Central-processing sources 
of interference do not appear to depend on the number of controls 
used in the system. There are, however, motor-related sources of 
interference that may be important when a multi-axis manipulator 
is controlled by a single limb. (See Appendix B.) 

Pilot "capacity" is related to a minimum equivalent observa- 
tion noise ratio attainable by the subject. This noise ratio ap- 
parently depends on the nature of the subject's training experience, 
as well as on his inherent abilities. Interference can be accounted 
for by allowing the equivalent observation noise ratio associated 
with a given indicator to increase in inverse proportion to the 
fraction of the pilot's capacity allocated to that display. In- 
corporating the model for task interference into an optimal-control 
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framework yields a composite model from which reliable predictions 
of overall system performance can be obtained. 

A metric for pilot workload, the "workload index," is defined 
as the fraction of the controller's capacity that is required to 
perform a given task to some specified, or criterion, level of per- 
formance. A theoretical study of the relation between workload 
index and system parameters and comparisons of predicted workload 
index with pilot-opinion data reported in the literature indicate 
that this is a reasonable metric for workload. Because of the 
difficulty of obtaining a reliable numeric to associate with "full 
capacity," we suspect the workload index will serve more reliably 
as a means for comparing the relative demands on the pilot imposed 
by various tasks, rather than as a measure of absolute workload. 

In addition to these theoretical results, a number of interest 
ing multi-task experiments were performed. These are discussed in 
detail in appendices and the principal results are summarized below 

Single-axis compensatory tracking was studied under four condi 
tions of foveal and peripheral viewing. Both the location of the 
display and the orientation of the display indicator were varied. 
Vehicle dynamics were K/s , and a simulated first-order noise pro- 
cess was applied as a disturbance to vehicle velocity. Tracking 
performance was degraded as the display was moved from the center 
of the visual field into the periphery. In addition, peripheral 
tracking ability was significantly improved when the display indi- 
cator was oriented so that the subject could extrapolate a zero 
reference from his fixation point to the display. Both error vari- 
ance scores and normalized observation noise spectra increase with 
increasingly unfavorable viewing conditions. Changes in the noise 
spectra occurred primarily at low frequencies, which . suggests that 
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perception of indicator position was degraded more than perception 
of velocity. . On the average, perception in the periphery appeared 
to be better when the displays were located in the lower half of 
the visual field. Whereas the level of observation noise was roughly 
proportional to the error variance when the display was viewed 
foveally, it was almost invariant to the error variance when the 
display was viewed peripherally. Hence, the relative quality of 
peripheral perception can be expected to improve as the amplitude 
of the displayed signal increases. 

Experiments were performed in which two, three, and four inde- 
pendent axes were tracked simultaneously. A separate display was 
provided for each axis of control. Minimum display separation was 
16° visual arc. Visual scanning was not permitted: the subjects 
maintained fixation on one of the displays for the entire experi- 
mental trial. All multi-axis tasks showed evidence of task inter- 
ference (i.e., the error variance score on a given task was greater 
when multiple tasks were performed than when that task was performed 
singly). In general, increased error scores were accompanied by 
increased normalized observation noise spectra and lower human con- 
troller gain. The subjects showed no appreciable tendency to favor 
the foveal task when provided with foveal and peripheral tasks of 
approximately equal difficulty. Interference was greater when two 
axes were controlled by one hand operating a two-axis manipulator 
than when each hand operated a single-axis manipulator. 

The subjects were also allowed to scan while controlling the 
four independent axes. Pour separate displays were provided, lo- 
cated at the four corners of an imaginary square. Two experimental 
conditions were investigated; (a) homogeneous inputs, in which the 
spectral characteristics and total power levels of the four inputs 
were identical, and (b) nonhomogeneous inputs, in which the mean- 
squared input on the axis corresponding to the lower left display 
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was four times as great as the mean-squared inputs applied to each 
of the remaining three axes. The subjects fixated the upper two 
displays most of the time even when the inputs were homogeneous; 
apparently because of the superior visual information obtained in 
the lower portion of the peripheral visual field. Scanning behavior 
was changed negligibly when the input on the lower left axis was 
increased. The failure of the subjects to fixate the lower left 
display for a substantially greater fraction of time in this cir- 
cumstance stemmed, we assume, from the relative improvement of 
peripheral perception that accompanied a larger error signal on 
that display. 
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APPENDIX A 


APPENDIX A. APPARATUS AND PROCEDURES 


Two experimental programs are described in this report: an 

extensive study of multi-axis control behaviorj and a subsequent 
(and less extensive) study of interference effects within a single 
axis of control. The apparatus and procedures described in this 
appendix were, with some modifications, used throughout the prim- 
ary experimental program. To some extent, these same procedures 
were employed in the second program. Table A-l lists the set of 
experimental conditions common to most of the experiments. Devia- 
tions from these conditions are mentioned specifically in the pres 
entation of experimental results in Appendices B and C. 

In the primary experimental program, the subjects were pre- 
sented with four compensatory tracking displays, each of which con 
tained a stationary reference bar and a moving bar to indicate 
system error. The error bars were controlled by compatible move- 
ments of two 2-axis control sticks. The four axes were linearly 
independent, and simultaneous control was required for various 
combinations of 1,2,3, and 4 axes during the course of the experi- 
mental program. Figure A-l shows a linear flow diagram of one of 
the four axes. Throughout this experimental program we used a 
state-regulation configuration, as opposed to the command-input 
configuration previously used by us and other workers (Refs. 1-4) 
in order to provide compatability with recent theoretical develop- 
ments (Ref. 6). The forcing function was injected in parallel 
with the pilot’s control action and thus appeared as a disturbance 
on vehicle velocity. 
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TABLE A-l 


Experimental Conditions Common to Most Experiments 


Experimental 

Variable 

Standard Condition 

Displays 

Four displays arranged on the 
corners of a square whose sides 
were 16° visual arc in length. 
See Figure A-2. 

Controls 

Two 2-axis controls, with each 
axis of control affecting a 
single display. 

Contr oiled-element 
Dynamics 

K/s in all axes. Control gain 
was such that 1 newton of force 
produced a display deflection 
rate of 2 degrees visual arc per 
second . 

Forcing Functions 

Sums of sinusoids to simulate a 
first-order noise process with a 
break frequency at 2 rad/sec. 
Similar statistical properties, 
but different waveforms, on each 
axis. See Tables A-2 to A-k . 
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FIG.A-1 LINEAR FLOW DIAGRAM OF A SINGLE-AXIS COMPENSATORY 
MANUAL CONTROL SYSTEM 

System forcinq function, system error, and control 
movement are represented by i,x, and u, respectively. 
The controller remnant is represented by an equivalent 
observation noise r x , and the "perceived error" is 
shown as x'. H and V represent the human controller's 
describing function and the vehicle dynamics. 

The vehicle output is shown here as -x so that we may 
adopt the standard practice of indicating negative 
feedback . 



PRINCIPAL EXPERIMENTAL HARDWARE 


Computing Machinery 

An Applied Dynamics AD/4 Analog Computer was used to simulate 
vehicle dynamics, drive the displays, and compute mean-squared sys- 
tem errors. An SDS-940 time-shared digital facility was used to 
generate forcing functions, convert analog data to digital format 
for storage on magnetic tape, and aid in data analysis. 

Subject Booth 

The displays and controls were located in a subject booth 
that was isolated both acoustically and visually. A chin rest was 
provided to control the subject's point of regard and to minimize 
rotational head motions. 

Displays 

The subject was provided with four oscilloscopic displays 
arranged on a plane surface located 72 cm in front of the subject's 
point of regard. The displays were located at the corners of an 
imaginary square, as shown in the scaled drawing of Figure A-2a. 

The centers of the displays were separated by about 16 degrees of 
visual arc along the sides of the square and about 22 degrees along 
the diagonal. Each scope face was masked with black paper to pro- 
duce a rectangular background of 5 by 10 cm. The phosphor of the 
display tube was type P-11, which gave a bluish cast to the refer- 
ence and error indicators. An overlaid reticle provided a rectan- 
gular array of grid lines separated by about 1/2 cm. Intensity 
levels for the display and background were adjusted to be the same 
for all displays and were kept the same throughout the experimental 
program. A constant low level of room lighting was maintained. A 
typical display presentation (minus the grid lines) is shown in 
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a. Four-axis Display Configuration 
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FIXATION 
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b. Horizontal Reference Extrapolation 



EXTRAPOLATED 

REFERENCE 


FIXATION 


c. Vertical Reference Extrapolation 

FIG.A-2 DISPLAY CONFIGURATION USED IN THE EXPERIMENTS 
Dimensions Shown in Degrees of Visual Arc 



Figure A- 3; the dimensions shown indicate degrees of visual arc 
with reference to the subject's point of regard. 

Preliminary investigation revealed that peripheral tracking 
performance was aided by the ability of the subject to extrapolate 
a zero reference from his fixation point to the peripheral display. 
This was true apparently because perception of the stationary base- 
line presented on the peripheral display faded after a few seconds. 
In order to provide similar viewing conditions for each fixation 
point, the error indicators of the upper left (UL) and lower right 
(LR) displays were presented as vertical bars which moved in the 
horizontal dimension, and the lower left (LL) and upper right (UR) 
were horizontal bars which moved in the vertical dimension. This 
arrangement allowed the subject to extrapolate a zero reference 
only to the peripheral display located in the nearest clockwise 
position to his fixation point, no matter which of the four dis- 
plays was designeated as the fixation point. Examples of horizon- 
tal and vertical reference extrapolation are shown in Figures A-2b 
and A-2c, respectively. 

Controls 

The subject manipulated two aluminum sticks, each of which 
was attached to a force-sensitive hand control (Measurement Sys- 
tems Hand Control, Model 435)* The stick-control combination pro- 
vided an omnidirectional spring restraint with a restoring force 
of about 8 x 10^ dynes per centimeter deflection of the tip of the 
stick. The subject used wrist and finger motions to manipulate 
the sticks and was provided with arm rests to support his forearms. 

The transducer of each hand control provided two independent 
electrical outputs, one proportional to the horizontal and the 
other proportional to the vertical component of deflection. 
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The sticks were allowed to move freely in both axes in all experi- 
ments. The error indicators in the inactive axes were clamped 
electronically at zero displacement. 

In order to provide a high degree of control-display compat- 
ibility, each control was oriented so that the stick was horizon- 
tal and could be moved in a plane parallel to the plane of the dis- 
plays. Each display was controlled by a component of stick move- 
ment along the same axis as the motion of the error indicator. 

Thus, the UL display was controlled by x-axis (i.e., horizontally- 
directed) deflections of the left control stick, the LL display 
by y-axis motions of the left stick, the UR display by y-axis 
motions of the right stick, and the LR display by x-axis motions 
of the right stick. The response of an error indicator was in 
the same direction as the corresponding component of control de- 
flection. 

Oculographic Recording Apparatus 

Eye movements were monitored via electro-oculographic tech- 
niques (Ref. 17). Voltages proportional to eye position (relative 
to head position) were detected via Beckman biopotential skin elec- 
trodes and preamplified by Electro Instruments Model A20B DC ampli- 
fiers. Separate recording systems were used to monitor horizontal 
and vertical eye movements . 

CONTROL SYSTEM PARAMETERS 
Controlled-Element Dynamics 

The controlled-element dynamics were K/s in all axes for all 
experiments. In all but one experiment, the control gains were the 
same on all axes. For most of the experiments, the control gain 
was such that 1 newton of force produced an error rate of 2 degrees 
visual arc per second. 
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Forcing Functions 


Forcing-functions were provided via a multichannel FM mag- 
netic tape system during training and were generated by the 9^0 
digital system during data-taking sessions. Up to 13 sinusoids 
were summed to provide signals that were random-appearing and 
whose spectra approximated white noise processed by a first-order 
filter with a pole at 2 rad/sec. In order to assure orthogonality 
among the component sinusoids, an integral number of cycles of 
each component was contained in the measurement interval (about 
200 seconds). Thus, each component was a harmonic of the funda- 
mental frequency 

to o = 2 tt/200 = .031 rad/sec . 

For most of the experiments the mean-squared input was about 2.2 

p 

(arc-degrees/sec) on each axis, where the units refer to the an- 
gular velocity of the error indicator that would result if no con- 
trol action were taken by the subject. 

Three sets of forcing functions were used for data taking. 
Tables A-2 through A-4 show for each sinusoidal component of each 
forcing function the radian frequency, the number of wavelengths 
contained in the measurement interval, and the relative amplitude. 
(The component amplitudes have been normalized to yield a mean- 
squared signal level of unity.) The initial phase shifts asso- 
ciated with each component of a forcing function were selected 
from a random process having a uniform distribution between 0 and 
2tt. The four forcing functions contained in set B (Table A-3) 
were identical in order to provide tasks on each axis that were 
as nearly alike as possible. This input set was used only for 
experiments in which the axes were tracked one at a time. For 
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TABLE A- 2 


Parameters of Forcing-Function Set A 


AXIS 1 

AXIS 2 

No. of Wave- 
Lengths in 
Measurement 
Interval 

Frequency 
(rad/sec) j 

Relative 

Amplitude 

No . of Wave- 
Lengths in 
Measurement 
Interval 

Frequency 
(rad/sec ) 

Relative 

Amplitude 

3 

.092 

.289 

4 

.12 

.354 

8 

.25 

.406 

10 

.31 

.378 

18 

.55. 

.463 

19 

.58 

.480 

30 

.92 

.475 

33 

1.0 

.485 

45 

1.4 

.517 

47 

1.4 

.506 

68 

2.1 

.486 

72 

2.2 j 

.448 

90 

2.8 

.462 

86 

2.6 

.430 

134 

4.1 

.434 

126 

3.9 

.465 

178 

5.5 1 

.384 

190 

5.8 

.393 

266 

8.2 

.336 

258 

7.9 

.326 

358 

11.0 

.281 

370 

11.4 

.290 

518 

15.9 

.262 

530 

16.3 

.251 








TABLE A- 3 


Parameters of Forcing-Function Set B 
(Parameters identical on all axes) 


No. of Wavelengths 
in Measurement Interval 

Frequency 
(rad/sec ) 

Relative 

Amplitude 

6 

.18 

.449 

17 

.52 

.497 

32 

.98 

.514 

48 

1.5 

.474 

66 

2.0 

.466 

94 

2.9 

.461 

130 

4.0 

.424 

186 

5.7 

.381 

262 

8.0 

.325 

366 

11.2 

.281 

522 

16.0 

.238 

733 

22.5 

.202 

1052 

32.3 

.162 


A-ll 




.-12 


TABLE A- 4 


Parameters of Forcing-Function Set C 


No. of Wave- 
Lengths in 
Measurement 
Interval 

Frequency 
(rad/sec ) 

Relative 

Amplitude 

No . of Wave- 
Lengths in 
Measurement 
Interval 

Frequency 
(rad/sec ) 

Relative 

Amplitude 

AXIS 2 

AXIS 1 

6 

.18 

.449 

8 

.25 

.491 

17 

.52 

.497 

18 

.55 

.456 

32 

.98 

.514 

30 

.92 

.467 

48 

1.5 

.474 

45 

1.4 

.509 

66 

2.0 

.466 

68 

2.1 

.479 

94 

2.9 

.461 

90 

2.8 

.455 

130 

4.0 

.424 

134 

4.1 

.427 

186 

5.7 

.381 

178 

5.5 

.378 

262 

8.0 

.325 

266 

8.2 

.331 

366 

11.2 

.281 

358 

11.0 

.276 

522 

16.0 

.238 

518 

15.9 

.244 

733 

22.5 

.202 

737 

22.6 

.202 

1052 

32.3 

.162 

1048 

32.2 

.162 

AXIS 3 

AXIS 4 

7 

.22 

.445 

9 

.28 

.510 

16 

.49 

.494 

19 

.58 

.473 

35 

1.1 

.524 

33 

1.0 

.478 

46 

1.4 

.415 

47 

i 1.4 

.498 

62 

1.9 

.467 

12 

2.2 

• .441 

82 

2.5 

.499 

86 

2.6 

,424 

138 

4.2 

.456 

126 

3.9 

.458 

182 

5.6 

.368 

190 

5.8 

. 387 

270 

8.3 

.324 

258 

7.9 

.321 

362 

11.1 

.273 

370 

11.4 

.286 

526 

16.1 

.240 

530 

16.3 

.237 

745 

22.9 

.197 


22.7 

.197 

1044 

32.0 

.159 


31.9 

.162 










the experiments in which two or more axes were tracked simultane- 
ously, it was necessary to provide different inputs on each axis 
so that the tasks would appear to be linearly uncorrelated. Input 
set C was designed for this purpose. Although the four forcing 
functions in this set are composed of the same approximate fre- 
quency components, corresponding components do vary slightly so 
that no two forcing functions contain exactly the same frequencies. 
This design allows us to test for linear cross-couplings intro- 
duced by the subject. 

TRAINING AND EXPERIMENTAL PROCEDURES 
Subjects 

Four subjects, all of them instrument-rated pilots, partici- 
pated in this experimental program. Three subjects were active in 
the Air National Guard, and the remaining subject was active as a 
commercial pilot. Two of the subjects (JF,DM) had participated in 
previous experimental programs; the remaining subjects were novices 
with regard to experimental manual control situations. All of the 
subjects, by virtue of their occupations, were assumed to posess 
both good eyesight and a native ability for proficient manual con- 
trol . 

Instructions 

The subjects were instructed to minimize mean-squared track- 
ing error. When tracking more than one axis simultaneously, they 
were instructed to minimize a total score given as the sum of the 
mean-squared error scores obtained from each axis. (The scores 
were weighted equally in this computation.) The subjects were in- 
formed of their scores after each session, and histories of the 
performance of all subjects were posted and shown to each subject 
in an attempt to foster a spirit of competition. 
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Run Length 


All training and experimental trials lasted four minutes and 
were generally presented in sessions of three or four trials each 
with a minimum rest period of 10 minutes between sessions. Minimum 
rest periods of 1 minute were provided between successive trials 
within a session. 

Inputs 

A number of forcing functions were used during training under 
a given condition to minimize learning of the input. These forcing 
functions were of the type shown in Table A-4, except that the 
highest frequency component was absent. In order to minimize the 
effects of input differences on the experimental results, however, 
a single set of forcing functions was used in a given experiment. 

Training 

The subjects were trained for each experimental condition 
until their performance levels appeared to be stable. An average 
of nearly sixty JJ-minute trials of training was provided to each 
subject prior to the first experiment; substantially less training 
was required for subsequent experiments. In general, the subjects 
were trained in an equal mixture of the conditions to be investi- 
gated in a given experiment. 

DATA RECORDING 

All experimental data were recorded onto digital magnetic 
tape via the SDS-^O system and its associated peripheral hardware. 
Control of the experiment was effected through the STOREDATA system, 
a program written in a 9^0-compatible version of FORTRAN II which 
(1) generated the forcing functions, (2) provided a signal for con- 
trolling the analog computer, (3) performed on-line computations of 
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the incoming data, and (4) converted the data to digital format 
for storage. Data were sampled at the rate of 20 samples/second. 
All experimental trials were 4800 samples (4 minutes) in length. 
All of the analyses described in the following section (except 
for some of the eye-movement analysis) were performed on 4096 

samples (about 3 minutes, 20 seconds) beginning about 20 seconds 

* 

after the onset of the trial. 

DESCRIPTIVE MEASURES 
Mean-Squared Errors 

Mean-squared error (MSE) scores were computed for each axis 
in a given experimental trial, and a total performance measure was 
computed as the unweighted sum of these scores. Analyses of vari- 
ance were performed on selected sets of MSE scores to test the 
significance of differences in scores that accompanied changes in 
experimental conditions. 

Eye-Movement Statistics 

The following eye-movement statistics were computed from the 
multiaxis tracking data. 

(a) Praction of attention: Given as the fraction of 

time that a given display was fixated. 

(b) Fixation frequency: Defined as the number of 

observations of a given instrument divided by the 
total run length in seconds. 

(c) Mean observation time: Computed as the cumulative 

fixation time on a given display divided by the 
number of observations of that display. 


Our implementation of the fast-Pourier transform technique used 
in obtaining power spectra and describing function requires 2 N 
data points. 
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An ’’observation” was defined as a succession of samples cor- 
responding to foveal fixation of a single, display , bounded by 
samples indicating fixations of other displays. Successive obser- 
vations of the same display were not defined as such and were 
treated as a single observation. Measured observation times were 
necessarily multiples of the analog-to-digital conversion interval 
of 0.05 second. 

The subject’s fixation point was determined from recordings 
of the vertical and horizontal components of eye position by means 
of two zero-level detectors. The subject was assumed always to 
fixate one of the four displays. In order to discount the spurious 
fixations that were often indicated when the subject scanned along 
a nearly -diagonal path, all measured observations of less than 
0.25 second were disregarded. Since the cumulative time accounted 
for by these short-term observations was only about 1 percent of 
the total run time, the error introduced by our analysis procedure 
was well within the expected normal run-to-run variation. 

Power Spectra 

Power spectra were obtained using Fourier analysis techniques 
based on the Cooley-Tukey method of computing transforms (Ref. 18). 

In order to enhance the interpretabillty of the results , the funda- 
mental frequency component of the Fourier analysis was the same as 
the base frequency about which the forcing functions were constructed. 
Each spectrum, therefore, consisted of a set of lines spaced by 
approximately 0.031 rad/sec and extending from 0.031 to about 64 
rad/sec. Measurements beyond 37 rad/sec were disregarded. 
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It was convenient for analytical purposes to consider each 
power spectrum as the sum of two component spectra: (a) the 

"input-correlated" spectrum, consisting only of those measurements 
coincident with the forcing- function frequencies, and (b) the 
"remnant" spectrum, consisting of the remainder of the total power 
spectrum. This interpretation of the measurements was based on 
the assumption that the remnant was a broadband continuous function 
of frequency having a relatively low power density level, as com- 
pared to the input-correlated portion of the signal which contained 
a relatively high power density level at a few selected frequencies. 
Thus, measurements at input frequencies were assumed to represent 
only the linear response of the system, uncorrupted by the small 
amount of remnant in the measurement "window". (This assumption 
was tested for each spectral measurement.) 

Computation of the power spectrum allowed the partitioning of 
the signal variance into the portion of signal power correlated 
with the input and the portion due to remnant. These component 
scores were obtained by summing the spectral measurements obtained 
at input frequencies and at all frequencies excepting input fre- 
quencies, respectively. (The power measurement at zero frequency, 
representing the square of the mean, was not included in the latter 
summation. ) 

Estimates of the remnant component of the spectrum at input 
frequencies were needed for the computation of observation noise 
(discussed below) and also to provide an estimate of the signal- 
to-noise ratio at these frequencies. This measurement could not 
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be obtained directly, since there was no way to subdivide a single 
measurement into input-related and remnant-related components. 
Instead, estimates were provided by averages of the power spectral 
measurements obtained on either side of (but not including) an 
input frequency. The assumption was made that the remnant spectrum 
was a continuous function of frequency in the vicinity of the input 
frequencies. This has been shown to be a reasonably good assump- 
tion (Ref. 1). The averaging windows extended roughly 1/8 octave 
on either side of each input frequency. Since the spectral mea- 
surements yielded by the Fourier analysis were spaced linearly 
with frequency, the number of measurements included in the average 
increased with increasing frequency — ranging from 1 for the esti- 
mate at the lowest frequency to around 180 at the highest frequency. 

Describing Functions 

Human controller describing functions were obtained using the 
Fourier analysis techniques described above. Samples of the con- 
troller describing function — at input frequencies only — were 
obtained by dividing the transform of the control signal by the 
transform of the error signal. This technique is similar to those 
employed by Tustin (Ref. 19), McRuer, et al (Ref. 1), and Taylor 
(Ref. 20). Estimates of the signal-to-noise ratio at each input 
frequency were obtained from a comparison of the power measured 
at that frequency to the corresponding estimate of remnant power. 

In order to prevent the expected error in the amplitude-ratio esti- 
mate from exceeding 2 dB, estimates of the controller's describing 
function were disregarded at frequencies for which either the error 
or control power measurement failed to exceed the corresponding 
estimate of remnant power by 4 dB. 
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The describing functions presented in this report relate 
control activity to the display error. We have chosen to repre- 
sent control activity in terms of its equivalent effect on error 
rate when presenting the results of the multi-axis experiments. 
The amplitude ratios derived from these results thus have units 
of (deg/sec )/deg or, simply, sec"^. On the other hand, we found 
that control activity was best represented as newtons of force 
when presenting the results of the second experimental program. 
Accordingly, the amplitude ratios for this program are given in 
units of newtons/degree visual arc. Phase shift is given in de- 
grees throughout this report. 


Observation Noise 

Although our model of controller remnant is based upon a 

vector observation noise process, our measurement techniques do 

not readily permit us to extract, from the single spectrum $ , 

uu r 

the two noise components associated with estimation of display 
position and display rate. The best we can do, in terms of data 
manipulation, is to reflect remnant back to an equivalent scalar 
noise injection process. 


Consider an observation noise process r (t) injected onto 
system error. If this process is linearly uncorrelated with the 
input signal i(t), the closed-loop error and control spectra may 
be separated into the following independent input-related and 
remnant-related components (refer to Figure A-l) : 
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Solution of Eqs. (A-2a) and (A-2b) yields for the observation noise 
spectrum: 
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If the observation noise is injected onto error rate instead of 
error, we obtain 
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Since measurements of 


and $ 


can be obtained only at input 


frequencies, the observation noise spectrum obtained in this manner 
can be specified only at those frequencies. At frequencies suffici- 
ently below gain-crossover (i.e., where | HV | > > 1 ) the observation 
noise spectrum is approximately identical to the error spectrum at 
noninput frequencies. Thus, at low frequencies. 


or 


$ = $ 

rr xx„ 

x r 

. 2 

$ =w <l> „ 

rr • xx 

x r 


(A-4a) 
( A-4b ) 


A-20 



r 


Equations (A-3) and (A-*0 were both used to compute the observa- 
tion noise spectrum for a given run. Equation (A-3) was used for 
estimates at frequencies of 1 rad/sec and higher. Use of this 
formula at lower frequencies led to anomalous results, apparently 
because of our inability to obtain reliable estimates of remnant 
control power at low frequencies. Since remnant error power was 
relatively large at low frequencies, Eq. ( A- 4 ) was used to compute 
the observation noise spectrum at frequencies below 1 rad/sec. 

Since the gain-crossover frequency was around 4 rad/sec under most 
experimental conditions, errors introduced by use of Eq . (A-M) were 
expected to be on the order of 0.25 dB at 1 rad/sec and less at 
lower frequencies. In addition, use of Eq . (A-4) provided more low- 
frequency estimates of the observation noise spectrum than did the 
formula of Eq. (A-3), since the estimates were not required to cor- 
respond to input frequencies. 

CALIBRATION OF THE ANALYSIS PROCEDURE 

The power spectra and the human controller describing function 
which are presented in this section in order to illustrate our mea- 
surement capabilities were all obtained during data-taking sessions 
and are representative of the kinds of measures obtained throughout 
the experimental program. All spectral measurements are presented 
in dimensions of signal power per measurement window. Although the 
remnant and noise spectra are more properly considered as samples 
of spectral density functions that are continuous with frequency, 

they are presented in the same units as the input-correlated spectra 

* 

to facilitate evaluation of the measurement techniques. 

2 

The measurement "window" has the form of {[sin(irw/o3 o ) ]/[ttu)/oj o ]} 

where w o is approximately 0.031 rad/sec. The remnant and noise 

spectra may therefore be converted to units of power per rad/sec 
by dividing by 0.031 rad/sec, equivalent to adding 15.1 dB. 
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The ability of the analysis procedures to obtain a correct 
power spectrum is illustrated by the comparison of theoretical 
and measured input spectra shown in Figure A-h . The "desired" 
spectrum is the spectrum that would have been obtained if there 
were no sources of error. The spectrum labelled "correlated power" 
contains the measurements obtained at the nominal input frequencies; 
the spectrum labelled "residual power" indicates samples of mea- 
surements obtained at other frequencies. The correlated power 
spectrum is within 0.1 dB of the theoretical spectrum at frequencies 
up to 8 rad/sec and begins to fall off relative to the theoretical 
spectrum at higher frequencies. The difference between the mea- 
sured and theoretical spectra at high frequencies reflects pri- 
marily the effects of a lowpass filter located at the input 
of the A/D converter. All spectral measurements presented in 
succeeding chapters of this report have been corrected to account 
for the effects of this filter. All potential sources of random 
error, such as (a) error in generating the input sinusoids, (b) 
analog noise, and (c) noise in the A/D converters are reflected 
in the residual power spectrum. The large separation between the 
correlated and residual spectra (about 60 dB at mid-frequencies) 
shows that we were highly successful in generating input signals 
which contained significant power at specified frequencies only. 

(The fraction of total input power that was contained at frequencies 
other than the specified input frequencies was generally less than 
2 x 10~\) 

In Figure A-5 we compare the remnant and input-correlated por- 
tions of the system error spectrum, (Fig. A-5a) and the control effort 
spectrum (Fig. A-5b) obtained during an experimental trial in which 
the upper left (UL) display was viewed foveally . The remnant portions 
of the error and control spectra were at least 10 dB below their 
corresponding input-correlated spectra at the high- and low-frequency 
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ends of the measurement range, and the separation was significantly 
greater at mid- frequencies . The relatively low levels of the 
remnant spectra allowed a valid estimation of the human controller 
describing function over the entire measurement range for this 
particular run, as was the case with most of the single-axis foveal 
measurements. The range of frequency over which valid describing 
functions could be made generally contracted as the task became 
more difficult because of the relative increase in controller 
remnant . 

Also shown in Figure A-5 are the residual error and stick spec- 
tra measured in the absence of tracking activity on the UL display. 
The remnant spectra are seen to be at least 10 dB greater than the 
corresponding residual spectra at all measurement frequencies, 
which fact would seem to indicate that our remnant measurements 
are reliable over the entire measurement range. It should be 
noted, however, that the residual spectra were measured with es- 
sentially zero analog input and accordingly may not account for 
all the measurement noise (say, due to amplitude quantization 
effects) that occurs when the controller is tracking that axis. 


A more critical test of the reliability of our remnant mea- 
surements is to test their self-consistency. In the absence of 
system noise, the remnant error signal will be equal to the remnant 
control signal filtered by the vehicle dynamics (i.e., we assume 
that remnant is generated entirely by the human controller) . We 
should then observe that 
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A comparison of $ /$ with |v| in Figure A-6 shows that 

xx r uu r 

the two spectra coincided at frequencies above 1 rad/sec, but that 

o 

the error/control ratio was consistently less than |V| at lower 
frequencies. These results suggest that, at low frequencies, our 
measurements either consistently under-estimated the amount of 
remnant error power or over-estimated the amount of control power. 

If we attribute measurement errors to additional noise sources 
that are linearly uncorrelated with the remnant, we must conclude 
that measurement error must have occurred predominantly on the 
control channel, since uncorrelated noise powers will add, rather 
than subtract, on the average. Figure A-5 confirms our conclusion 
that the remnant error measurements were more reliable than the 
remnant control measurements at low frequencies, since the dB 
spread between remnant and residual power was twice as great on 
the error channel than on the control channel. 

In order to show that the human controller describing functions 
obtained by us are compatible with those that have been obtained 
by other investigators under similar tracking conditions, a typical 
describing function of ours is compared in Figure A-7 with a describ- 
ing function published by System Technology, Inc. in Figure 33 of 
Ref. 1. Both describing functions were obtained during foveal 
tracking of a single display with vehicle dynamics of K/s . (The 
STI data have been scaled to correspond to a K of unity.) The 
forcing functions used in the two experiments were different, 
however. STI used a command input whose spectrum was essentially 
rectangular with a cutoff at 2.5 rad/sec, whereas we used the 
vehicle disturbance described in Chapter III of this report. 

Figure A-7 shows that the two describing functions are similar. 

The most significant difference is the somewhat higher gain 
achieved in the BBN experiments, resulting in a higher gain- 
crossover frequency for the BBN data (about 6.5 rad/sec) than 
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that exhibited by the STI data (about 4.5 rad/sec). We suspect 
that the difference in controller gain is due in part to differ- 
ences in (a) the input signals, (b) physical characteristics of 
the manipulators, and (c) training procedures adopted by STI and 
BBN. 
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APPENDIX B. EXPERIMENTAL RESULTS: MULTI-AXIS CONTROL SYSTEMS 

The results of the experimental program on multi-axis control 
systems are presented In this appendix. Most of the results are 
presented in the form of averages taken across subjects. Average 
measures for each subject for each experimental condition are 
given in Appendix D. Except where otherwise stated, the set of 
experimental conditions outlined in Table A-l applies to each of 
the experiments. 

EXPERIMENTAL PLAN 

The primary goal of this experimental program was to provide 
a substantial body of data which would enable us to build and vali- 
date models for predicting human control and monitoring behavior 
in multi-axis control situations. Two variations of a four-axis 
manual tracking task were performed in which the controller was 
allowed to scan among the displays. Additional two-, three-, and 
four-axis tasks were investigated in which visual scanning was 
prohibited. The object of these experiments was to provide data 
against which models for task interference could be tested most 
readily. (A model for task interference is developed in Section 3 
of this report, and experimental validation is provided in Sections 
4 and 5 . ) 

In addition to the multi-axis experiments, two single-axis 
experiments were also performed. One of these was performed to 
evaluate alternative display formats for use in the multi-axis 
experiments. The other was a set of calibration experiments to 
determine the base levels of performance under each viewing con- 
dition employed in the multi-axis experiments. 
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COMPARISON OF TWO DISPLAY FORMATS 


Experimental Conditions 

The following two display formats were compared in terms of 
their effectiveness as tracking displays: (1) a moving error dot 

and stationary reference circle, and (2) a moving error bar and 
stationary reference bar. Each type of display was tracked when 
viewed foveally and when located 30 degrees into the periphery 
along the horizontal axis. Motion of the error indicators was in 
the vertical direction, thereby allowing the subject to extrapo- 
late a zero reference to the peripheral display. Only one display 
was tracked during a single experimental run. Every subject 
tracked each display twice under each viewing condition — once 
with the left hand and once with the right. Forcing-function 
Set A (Table A-2) was used, and the control gain was such that 
1 newton of stick force produced a rate of error deflection of 
4 deg/sec. 

MSE Scores 

Table B-l shows that the subjects achieved lower mean-squared 
error scores for both the foveal and peripheral viewing conditions 
when presented with the bar display. The differences were about 
10 % when viewing foveally and about 25$ for peripheral viewing. An 
analysis of variance of these scores indicated that both differences 
were significant at the 0.05 level. Because of the superior per- 
formance achieved with the bar display, the bar display was used 
for the remainder of the experimental program. Scores for indivi- 
dual subjects are given in Table D-l of Appendix D. 

SINGLE-AXIS CALIBRATION EXPERIMENTS 
Experimental Conditions 

In this experiment we obtained the complete set of single-axis 
base level performance measures required by our model of the multi- 
variable control situation. Each subject tracked each of four axes 
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TABLE B-l 


Effect of Display Format on Mean-Squared Error Scores 



Mode of Viewing 

Display Format 

Foveal 

Peripheral 

Circle, Dot 

.11 

.80 

Bar, Bar 

.10 

.63 


? 

MS error scores in deg visual arc. 

Average of 4 subjects, 2 trials per condition. 


for each of the four fixation points to make a total of sixteen 
single-axis trials. There were four viewing conditions associated 
with each axis: (a) foveal, (b) 16 degrees into the periphery 

with the ability to extrapolate the zero reference, (c) 16 degrees 
into the periphery with no reference extrapolation possible, and 
(d) 22 degrees into the periphery (along the diagonal), also with 
no reference extrapolation. The forcing functions were made iden- 
tical on all axes so that interaxis differences in tracking behav- 
ior would not be induced by differences among forcing functions. 

MSE Scores 

The effects of relative fixation point on average mean-squared 
error scores are shown in Table B-2. Inter-axis standard devia- 
tions, based on the scores (averaged across subjects) corresponding 
to each viewing condition, are shown in Table B-2a. Inter-subject 
standard deviations are given in Table B-2b. The latter measures 
were computed from the subject means obtained by averaging the four 
MSE scores corresponding to each relative fixation point. System 
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TABLE B-2 


Effect of Relative Fixation Point 
on Single-Axis Mean-Squared Error Scores 


a. Average Scores for Each Axis Tracked 


Axis 

Relative Fixation Point 

Tracked 

: 

1 

Foveal 

16° Periph. 
Ref Ext 

16° Periph 
No Ref Ext 

22° Periph 
No Ref Ext 

UL 

.12 

.55 

.73 

1.7 

LL 

.14 

.32' 

.63 

1.4 

LR 

.13 

.45 

1.3 

1.5 

UR 

.13 

• 39 

1.5 

2.0 

Mean 

.13 

.43 

1.0 

1.6 

SD 

.0098 

.094 

.43 

.25 

SD/Mean 

0.08 

.22 

.42 

.16 


Average of 4 subjects, 1 run per subject. 


b. Average Scores for Each Subject 


Subject 

Relative Fixation Point 

Foveal 

16° Periph. 
Ref Ext 

16° Periph 
No Ref Ext 

22° Periph 
No Ref Ext 

JF 

.081 

1 

.23 • 

.52 

1.1 

DM 

.12 

• 32 

.58 

1.4 

GP 

. 18 

.64 

1.8 

2.1 

HS 

.14 

.52 

1.3 

1.9 

Mean 

.13 

.43 

1.0 

1.6 

SD 

.043 

.19 

.60 

.50 

SD/Mean 

• 33 

• 45 

.58 

.30 


Average of 4 runs per subject. MS error scores in deg of visual arc. 
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error and control effort scores for each subject for each viewing 
condition are shown in Tables D-3 through D-7 of Appendix D. An 
explanation of the symbols appearing in these tables is given in 
Table D-2. 

The rank ordering of the tasks in terms of mean-squared error 
scores was, from easiest to most difficult: foveal, 16° separation 
with reference extrapolation, 16° separation with no reference ex- 
trapolation, and 22° separation. The fractional differences in 
scores between pairs of tasks in the above ordering decreased with 
increasing task difficulty. Similarly, the statistical significance 
of the differences (as given by an analysis of variance of the er- 
ror scores) decreased with increasingly difficult pairs of condi- 
tions. The easiest of the peripheral tasks yielded a score that 
was about 3.3 times the foveal score (significant at the 0.001 
level). Removal of the facility to extrapolate the baseline in- 
creased the score by an additional factor of 2.4, a difference 
significant at the 0.01 level. The score obtained from viewing 
at 22° was about 60% greater than the 16 °, no reference, score. 

The latter difference was minimally significant at the 0.05 level. 

The relatively small inter-axis standard deviation (less than 
10% of the mean score) associated with foveal tracking indicates 
that the subjects were essentially equally proficient on the four 
axes tasks under this viewing condition. The larger normalized 
inter-axis SD's associated with th.e peripheral tasks may reflect 
effects such as the up-down differences in peripheral viewing 
capabilities which we found to exist. Except for the diagonal 
viewing condition, the inter-axis and inter-subject standard de- 
viations increased, relative to their corresponding mean scores, 
with increasing task difficulty. The inter-subject SD was consis- 
tently greater than the inter-axis SD for each viewing condition, 
reflecting differences in overall tracking abilities among subjects. 
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TABLE B-3 


Effect of Display Location on 
Single-Axis Mean-Squared Error Scores 


a. Horizontal Viewing, 16° Display Separation 


Reference Extension 
No Reference Extension 


Location of Axis Tracked 


Left 

Right 

.32 

.39 

.73 

1.3' 


b. Vertical Viewing, 16 ° Display Separation 


Reference Extension 
No Reference Extension 


Location of Axis Tracked 


Op 

Down 

.54 

.45 

1.5 

.b 3 


c. Diagonal Viewing, 22° Display Separation 


Location of Axis Tracked 
Left Right Average 


Up 

1.7 

2.0 

1.8 

Down 

1.4 

1.5 

1.4 

Average 

1.6 

1.7 

— 


2 

Average of 4 subjects. MS error scores in deg visual arc. 

The effects of display location on average peripheral MSE scores 
are shown in Table B-3. Left-right and up-down differences are shown 
respectively in Tables B-3a and B-3b for the 16° viewing angle with 
and without reference extrapolation. Up-down and left-right differ- 
ences for 22° diagonal viewing are shown in Table B-3c. The greatest 
left-right difference occurred for the 16° viewing condition with no 
reference extrapolation. The score obtained when fixating left and 
tracking the display on the right was about 75? greater than the score 
obtained in the reverse condition (Table B-3a, bottom row). Why this 
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is so is not clear, especially since three of the four subjects 
were right-handed. The largest up-down difference occurred again 
for the 16° viewing condition with no reference extrapolation. 

The score obtained when fixating down and tracking up was almost 
2.5 times the score obtained when fixating up and tracking down 
(Table B-3b, bottom row). 

The smaller left-right and up-down differences in MSE scores 
which were observed for the diagonal viewing conditions were con- 
sistent in direction with the above results. For example. Table 
B-3c shows that the largest MSE score was obtained when the sub- 
ject fixated the lower left display and tracked the upper right, 
whereas the lowest score (for diagonal viewing) was obtained when 
fixating upper right and tracking lower left. 

Because of the relatively large variances in the scores, an- 
alysis of variance tests failed to attribute statistical signifi- 
cance to the left-right and up-down differences. Nevertheless, 
because of the nonhomogeneous scanning behavior exhibited by the 
subjects in the multiaxis control situations (described later in 
this appendix), we suspect that the up-down differences reflect 
important differences in the subjects’ viewing capabilities. 

In order to provide an overall-performance measure that will 
be useful for interpreting the multi-axis results discussed later 
in this appendix, we show the average total performance score in 
Table B-4. This measure is defined here as the sum of the four 
scores (one foveal and three peripheral) corresponding to fixation 
of a single display. Scores for individual subjects are given in 
Table D-8 of Appendix D. The largest total score on the average 
was achieved from fixation of the lower left display. This score 
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TABLE B-4 

Effect of Fixation Point on Total Mean-Squared Error Score 


Display 

Fixated 


2 

MS error scores in deg visual arc. Average of *1 subjects, 
one score per subject. 

TABLE B-5 

Partitioning of Average Mean-Squared Error and Control Scores 


Display Fixated 



Left 

Right 

Average 

Up 

2.6 

2.7 

2.6 

Down 

3.9 

3.5 

3.7 

Average 

3.2 

3.1 

3.2 


Mode of Viewin g 


MS error, X 2 
(deg 2 ) 

Foveal 

.13 

16° Periph 
Ref Ext 

.43 

16° Periph 
No Ref Ext 

1.0 

22° Periph 
No Ref Ext 

1.6 

2 

Error variance, a 
(deg 2 ) x 

.13 

.41 

.81 

1.2 

°x /x2 

.99 

.97 

.86 

.78 

Correlated error, a . 
(deg2> xi 

.095 

.20 

.22 

.27 

? 

Remnant error , a 
(deg 2 ) 

^r 

on 

o 

• 

.22 

.59 

.93 

o 2 /o 2 ] 

xr x 

B 

.50 

.70 

.77 

2 

Control variance, o 
(deg/sec) 2 

4.2 

5.5 

6,1 

7.2 

' 2 
Correlated Control, o . 

(deg/sec) 2 u 

B 

2.6 

2.6 

2.6 

2 

Remnant Control, a 
(deg/sec ) 2 

BH 

2.9 

3.5 

4.7 

ur* 7 u 

.21 ; 

.47 

.54 

.63 


Data averaged over four subjects, four runs per subject. 
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was about 1.6 times as great as the lowest score (corresponding to 
fixation of the upper left display). Left-right performance dif- 
ferences were on the average only about 5 percent and were not 
statistically significant. On the other hand, the average score 
corresponding to fixation of the lower displays was about 1.4 
times the average score when fixation was directed at the upper 
displays. An analysis of variance showed this difference to be 
significant at the 0.05 level. 

Analysis of the total performance measure thus reveals that 
significantly better visual information is obtained overall when 
the upper displays are fixated than when the lower displays are 
fixated. On this basis we would predict that the subject would 
tend to fixate the upper displays more than the lower displays 
when tracking the four displays simultaneously, other conditions 
being equal. 

Comparison of the mean-squared error score with the error 
variance (mean-squared error minus the square of the mean error) , 
along with a partitioning of the error and control variances into 
input-correlated and remnant components, is given in Table B-5. The 
error variance was nearly identical to mean-squared error for foveal 
viewing and for peripheral viewing with reference extrapolation; 
thus, the mean error was essentially zero for these conditions. 

When reference extension into the periphery was not possible, 
however, the error variance was significantly less than the mean- 
squared error, accounting for only 78? of the latter for the 22° 
viewing condition. We suspect that the occurrence of a significant 
nonzero mean error was a direct consequence of the subject's in- 
ability to estimate precisely the location of the zero reference. 


B-9 



There was no appreciable difference between mean-squared con- 
trol movement and the variance of the control movement. Therefore, 
we have omitted the mean-squared control score from Table B-5. Note 
that when the vehicle dynamics are K/s and the input has zero mean, 
it is necessary for the subject to apply a control signal with zero 
mean in order to maintain absolute stability of the system. 

The fractions of error and control variance accounted for by 
controller remnant increased monotonically with the difficulty of 
the basic task, primarily because the remnant powers increased. 

In addition, the input-correlated portion of the control variance 
was greatest for the foveal task and was about 15!? less for all 
of the peripheral tasks. This trend in the correlated control 
power suggests that the controller generated his highest gain for 
foveal viewing and a somewhat lower gain for the three peripheral 
conditions. The monotonically increasing remnant power, on the 
other hand, suggests a monotonically increasing observation noise 
process with increasing task difficulty. These predictions are 
substantially borne out by the describing function and observation 
noise measurements reported below. 

Observation Noise Spectra 

Average power spectral density functions of normalized obser- 
vation noise are given for the four viewing conditions in Figure B-l. 
Averages were obtained across subjects and across axes tracked; 
thus, each measurement represents the average of sixteen spectral 
density functions (hereinafter referred to simply as "spectra"). 
Normalization is with respect to error variance. The spectra as 
shown include power contained at negative as well as positive fre- 
quencies and have units of normalized power per rad/sec. The data 
shown in Figure B-l are presented in tabular form in Table D-9 of 
Appendix D. 
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(dB) 




Although there were no consistent differences amo'ng the four 
average spectra at high frequencies, the low-frequency normalized 
observation noise increased appreciably as viewing conditions were 
made less favorable. There were no appreciable differences between 
the normalized noise processes associated with the two peripheral 
viewing conditions that did not permit reference extrapolation. 

If we were to plot the absolute (i.e., unnormalized) observation 
noise spectra, however, the differences would be accentuated and 
we would see that the relationship of observation noise to viewing 
conditions was consistent with the relationship of the remnant 
error and stick scores to viewing conditions. 

Table B-6 shows that the inter-axis standard deviation of the 

normalized observation noise was relatively small — generally on 

# 

the order of 1.0 to 1.5 dB at a given measurement frequency. The 
inter-subject standard deivations, shown in Table B-7, were about 
twice as great — around 2.5 to 3«0 dB — as might be expected from 
differences in tracking ability among subjects. 

Describing Functions 

Average human controller describing functions are presented 
graphically for the four viewing conditions in Figure B-2 and are 
tabulated in Table D-10 of Appendix D. As we predicted from the 
analysis of the input-correlated portion of the control power, the 
primary difference among the describing functions was the higher 
gain at low and mid frequencies accompanying foveal viewing. The 
approximate gain-crossover frequencies for foveal and peripheral 

if 

Standard deviations were computed on the same basis as the standard 
deviations of the MSE scores given in Table B-2, except that the 
inter-axis SD was based on observation noise measures obtained 
from the lower right axis only. 


B-12 




L3 










TABLE B-7 


Effect of Relative Fixation Point on Inter-Subject Standard 
Deviations of Single-Axis Normalized Observation Noise Spectra 


Frequency 

F Relative ] 

Fixation Point 

(rad/sec ) 

Foveal 

16° Sep 
Ref Ext 

16° Sep 
No Ref Ext 

22° Sep 
No Ref Ext 

.05 

3.9 

3.9 

3.0 

4.5 

.12 

4.0 

2.5 

2.4 

5.0 

.25 

1.5 

5.4 

4.2 

0.7 

.35 

1.3 

3.3 

1.4 

4.6 

.50 

2.4 

2.9 

1.6 

1.8 

.71 

3.0 

2.1 

1.0 

2.5 

1.0 

2.6 

4.'0 

5.4 

1.8 

1.5 

2.2 

3.2 

1.9 

2.0 

2.0 

2.5 

1.7 

3.1 

1.9 

2.9 

2.9 

2.5 

2.5 

2.0 

4.0 

2.4 

2.5 

1.6 

3.7 

5.7 

2.0 

2.5 

4.7 

2.7 

8.0 

2.2 

0.5 

3.6 

2.5 

11.0 

2.4 

3.6 

1.7 

2.6 

16.0 

2.1 

2.7 

1.0 

1.8 

22.0 

2.0 

4.7 

2.6 

2.6 

32.0 

2.3 




Average 

2.5 

3.0 

2.6 

2.7 


Axis Tracked: Lower Right 

Standard deviations in dB. 
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viewing were, respectively, 5 and 4 rad/sec. In addition, a some- 
what larger phase lag was observed at high frequencies for peri- 
pheral viewing, and the three peripheral amplitude-ratio curves 
appeared to exhibit a resonance peak around 16 rad/sec, whereas 
the peak for foveal tracking was closer to 22 rad/sec. 

Inter-axis standard deviations of the gain and phase-shift 
measurements are presented in Table B-8,and Table B-9 shows inter- 
subject standard deviations. The inter-axis gain and phase SD's 
were both relatively small, about 1-2 dB on the average for the 
gain measurements and around 10 degrees on the average for phase 
shift. The average inter-subject standard deviation was somewhat 
greater for the gain measurements — about 3 dB. The standard 
deviation in phase shift was generally under 10 degrees, although 
the variability was considerably greater for some of the high 
frequency phase-shift measurements obtained during peripheral 
viewing with no reference extension. 

MULTIAXIS TRACKING PERFORMANCE WITH NO VISUAL SCANNING 
Experimental Conditions 

This experiment was designed to determine whether or not there 
is interference among multiple tasks performed in parallel when 
the displays are separated, and to determine the nature of such 
interactions as might exist. We consider "interference" to exist 
whenever a single-axis performance measure observed on a given axis 
differs significantly from the same measure obtained on that axis 
when simultaneous tracking of two or more axes is required. In 
order to isolate such interference from the effects of visual 
scanning, the subjects were required to fixate a single display 
while tracking two or more axes. 
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TABLE B-8 


Effect of Relative Fixation Point on Inter-axis Standard Deviations of Single-axis 
Human Controller Describing Functions 

Computed from average describing functions of four subjects, 4 runs per subject. 


Frequency 1 Relative Fixa tion Point 

(rad/sec) Foveal 16° Sep, Ref Ext 


Gain(dB) Phase (deg)||. Gain(dB) [ Phase (deg) 


• 5 

1.0 

1.5 

2.0 

2.9 

4.0 
5.7 

8.0 
11 . 
16 . 
22 . 


32. 


Average 






















TABLE B-9 


Effect of Relative Fixation Point on Inter-subject Standard Deviations of Single-axis 
Human Controller Describing Functions 


Axis Tracked: Lower Right, One run per subject 










This experiment can be divided logically into three distinct 
phases. In the first phase, the subject tracked two displays: 
one foveally and one peripherally. This condition was investigated 
partly to complement and verify the earlier set of experiments 
(Ref. 4) and partly to provide the most straightforward procedure 
for investigating a simple foveal-peripheral interference. The 
second phase of this experiment was performed to investigate 
interference among peripheral tasks only . Three peripheral dis- 
plays were tracked individually and simultaneously. One foveal 
and three peripheral axes were tracked simultaneously in the third 
phase of this experiment in order to provide an indication of the 
interference that would arise in the four-axis tracking task. 

The four-display configuration shown in Fig. A-H was used through- 
out this experiment. Input Set C (Table A-4) was used, and the 
experimental conditions were otherwise as shown in Table A-l. 

In order to provide a two-axis situation that was to a large 
extent compatible with the two-display conditions investigated 
•previously (Ref. 4), only the configurations allowing peripheral 
extrapolation of the zero reference were investigated. All such 
configurations were investigated. Each display was fixated in 
turn by each subject, and for each fixation point the subject was 
required to track: (a) the display fixated, (b) the peripheral 
display located in the nearest clockwise position, and (c) the 
foveal and peripheral displays simultaneously. 

One objective of the two-axis no-scan experiment was to de- 
termine whether the subjects would "attend” preferentially to the 
foveal task, as one might expect from habit, or whether they would 
distribute their efforts between the two axes in a manner appro- 
priate to the scoring situation. A second objective of this ex- 
periment was to determine the relation of the magnitude of the 
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interference to the number of hands required for control. Note 
that two hands were required for 2-axis control when the two active 
displays were aligned horizontally, whereas only one hand operating 
a single controller in two dimensions was needed when the displays 
were aligned vertically. 

In previous experimentation with a two-axis integrated display 
and control situation (Ref. 3)> we found a small interference which 
we ascribed to "visual-motor" effects. If that interference had been 
due primarily to cross-coupling effects at the motor end, we would 
expect to find a greater interference when one hand was used for 
control than when two hands were used. On the other hand, if the 
interference found in the previous experiment had arisen primarily 
from mechanisms residing in the visual or central pathways, then 
we would expect the results obtained in the two-axis experiments 
with separated displays to be independent of the number of hands 
used for control. 

In order to reveal any fundamental differences that might exist 
between interference on the foveal and peripheral tasks, it was 
important that the subject assign equal importance to the two tasks. 

p 

The mean-squared input was therefore increased to 5.8 (deg/sec) 

2 

for the foveal task (as opposed to 2.2 (deg/sec) for the peripheral 
input) in an attempt to force the single-axis mean-squared error 
to be approximately the same for both foveal and peripheral tracking. 
Thus, if there were no interference , or if the interference were 
basically the same for both the foveal and peripheral tasks, the 
two tasks would contribute equally to the total performance score 
when the two axes were tracked simultaneously. It was assumed that 
the subjects would learn to assign equal subjective weightings to 
the two tasks in this hypothesized situation when given sufficient 
training. 
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The three-axis peripheral and four-axis no-scan experiments 
were performed in order to reveal the kinds of interference that 
might be expected in the scanning experiment. Consequently, the 
mean-squared inputs were kept the same at 2.2 (deg/sec) on all 
axes to provide compatibility with the first scanning experiment 
that was conducted. In order to economize experimental time, only 
the UL display was fixated throughout the experiment. Each subject 
tracked each display individually twice, the four displays simul- 
taneously twice, and the three peripheral displays simultaneously 
four times (twice each for the second and third phases of this 
experiment ) . 

MSE Scores 

Average mean-squared error scores are shown for all phases of 
this experiment in Table B-10. Individual subject averages are given 
in Tables D-ll and D-12 of Appendix D. The column labeled "Total 
Score" indicates the sum of the scores of the component tasks. In 
the case of the four-axis experiment summarized in part (c) of this 
table, the three-axis peripheral task is treated as a single, com- 
plex task, and the "1+3-axis" score indicates the sum of the 1-axis 
foveal and three-axis peripheral scores. 

Statistically significant interference was found in all three 
variations of this experiment. ("Interference" is defined here as 
the difference between the single-axis and multi-axis MSE scores.) 
Table B-lOa shows that the 2-axis total score was about 1.7 times the 
1-axis score. Interference on the foveal and peripheral axes dif- 
fered slightly: the peripheral score increased by about a factor 

of 2.0, whereas the foveal score increased by a factor of about 1.6. 
We suspect that the greater degradation in performance on the per- 
ipheral task was due primarily to the fact that the peripheral task 
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TABLE B-10 


Effect of Number of Axes Tracked on Average Mean-squared Error Scores 
a. One Foveal and One Peripheral Task 


Foveal 

Peripheral 

Total 

Score 

1— axis 

2-axis 

1-axis 

2-axis 

1-axis 

2-axis 

.32 

• 50 

.23 

• 45 

• 55 

• 95 


b. Three Peripheral Tasks 


16° , ref ext 

16° j no ref ext 


Total Score 

1-axis 

3-axis 

1-axis 

3-axis 

1-axis 

3-axis 

1-axis 

3-axis 

.27 

.90 

.51 

1.3 

1.2 

1.9 

2.0 

mm 


c. One Foveal and Three Peripheral Tasks 


Foveal 

Combined Periph. 

Total Score 

1-axis 

4-axis 

3-axis 

4-axis 

1+3-axis 

4-axis 

.11 

.30 

4.2 

4.8 

4.1 

5-1 


MS error scores in deg 2 visual arc 
Average of 4 subjects 
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was the easier task — as indicated by the 1-axis MSE score — despite 
our efforts to provide foveal and peripheral tasks of equal diffi- 
culty. Interference on the foveal, peripheral, and total scores 
was significant at the 0.001 levels. 

Table D-ll of Appendix D shows that the amount of interfer- 
ence between axes was dependent on the number of hands required for 
control. The ratio of the average 2-axis total score to the average 
1-axis total score was about 1.5 for tasks requiring two hands and 
about 2.0 for the one-handed control configuration. This difference, 
which was significant at the 0.01 level, suggests that interference 
at the motor level could be reduced somewhat by assigning control 
of the component tasks to separate limbs. We conclude from these 
results that the small (10-15?) interference observed in the earlier 
experiments with integrated controls and displays were caused largely 
by interference effects in the motor, rather than visual, pathways. 

Table B-lOb shows that the total 3-axis peripheral score was 
about twice the sum of the three individual 1-axis peripheral scores. 
This difference was significant at the 0.001 level. The ratios of 
3-axis score to 1-axis score were quite different for the three axes 
individually. The largest such ratio (about 3.6) was observed for 
the easiest of the peripheral tasks (16° viewing angle with refer- 
ence extrapolation). A 3-axis, 1-axis MSE ratio of about 2.5 was 
observed for the 16° peripheral task with no reference extrapolation, 
and the smallest ratio (about 1.5) was observed for the 22° periph- 
eral task. The tendency for the largest proportional increase in 
score to occur on the easiest task has been observed in previous 
experimental work (Ref. 3) and is consistent with the subject's 
instructed task of minimizing the total mean-squared error score. 

That is, if the subject must effectively apportion his information 
processing capability among the three tasks, it would seem that the 
optimal strategy is to devote the largest portion of his capacity to 
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the most important task and allow a relatively large increase in 
score to occur on the axis that contributes least to the total 
performance measure. The model validation studies presented in 
Section 4 support this hypothesis. 

Table B-lOc shows that the total score increased by only about 
25% when the simple foveal and complex peripheral tasks were per- 
formed simultaneously. This difference was statistically signifi- 
cant at the 0.05 level. The largest relative performance degrada- 
tion was observed for the foveal task, for which the 4-axis score 
was about 2.7 times the 1-axis score. The score for the combined 
peripheral task increased by only about 20% upon addition of the 
foveal task. The difference between the relative magnitudes of 
the foveal and peripheral interactions is consistent with the no- 
tions of optimality discussed above. 

The MSE scores obtained from the second and third phases of 
this experiment are shown again in Table B-ll to facilitate compari- 
son. This table shows at a glance that the score on each axis in- 
creased as the number of axes that were tracked simultaneously in- 
creased. In addition, the differences between the 3-axis and 1-axis 
scores were consistently greater than the differences between the 
4-axis and 3-axis scores. Table B-ll shows also that the ratios of 
error variance to mean-squared error observed under 4-axis tracking 
conditions varied with viewing conditions in about the same way as 
they did for single-axis tracking (Table B-5), except for the some- 
what lower ratio associated with foveal tracking. Thus, the inter- 
ference among axes implicit in the MSE scores cannot be attributed 
to any significant extent to increased manifestations of the dis- 
appearing-reference phenomenon. 
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TABLE B-ll 


Effect of Number of Axes Tracked on Average Peripheral Mean-squared 
Error Scores 


Mode of Viewing 

Mean— 

squared 

Error 

a 2 /x 2 


Number 

of Axes 

Tracked 

for 4-axis 


1 Axis 

3 Axes 

4 Axes 

Tracking 

Foveal 

.11 

— 

o 

on 

• 93 

16 periph, ref ext 

.27 

• 90 

1.0 

.97 

16 periph, no ref ext 

• 51 

1.3 

1.6 

.88 

22 periph, no ref ext 

1.2 

1.9 

2.2 

CO 

o 

Total Score 

2.1 

— 

5.1 

— 


MS error scores in deg 2 visual arc 
Average of 4 subjects 
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Observation Noise Spectra and Describing Functions 

Normalized observation noise spectra and human controller 
describing functions for the first phase of this experiment (simple 
foveal-peripheral interaction) are shown in Pigs. B-3 and B-4 for 
foveal and peripheral tracking, respectively. The graphs presented 
in these figures represent the average performance of four subjects 
when fixating the UR display and tracking either the UR display 
foveally, the LR display peripherally, or both displays simultan- 
eously without scanning. Figure B-3 shows that the 2-axis foveal 
observation noise spectrum was about 3-4 dB greater than the cor- 
responding 1-axis noise spectrum. The shapes of corresponding 1- 
and 2-axis spectra did not appear to differ in a consistent manner. 
The 2-axis foveal describing functions differed from the correspond- 
ing 1-axis DF primarily by an overall decrease in amplitude ratio 
of about 2-3 dB. The two-axis describing function also appeared 
to have a slightly greater high-frequency phase lag and lower 
resonant frequency than the 1-axis DF. Figure B-4 shows that the 
same kinds of 1-axis, 2-axis differences occurred on the peripheral 
axis . 


Observation noises and describing functions obtained from a 
single subject performing the 3-axis and 4-axis tasks are compared 
with the corresponding 1-axis performance measures in Fig. B-5 
through Fig. B-8. An increase in the number of axes to be tracked 
simultaneously had the following effects on all axes: (a) the 

overall level of the normalized observation noise spectrum increased, 
(b) the controller’s amplitude ratio decreased, and (c) the high- 
frequency phase lag increased slightly. For the most part, the 
shape of the observation noise spectrum is unaffected by the num- 
ber of axes tracked. The most noticeable exception to this general- 
ization is seen in Fig. B-5a, which shows that the 1-axis, 4-axis 
differences on the foveal axis are greater at frequencies below gain- 
crossover (around 4 rad/sec) than at higher frequencies. 
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MULTI AXIS TRACKING PERFORMANCE WITH VISUAL SCANNING 
Experimental Conditions 

The object of this experiment was to provide manual control 
data against which to test models of human scanning behavior. 

The subjects were required to track all four axes and were allowed 
to choose their own visual scanning pattern. Two variations of 
this experiment were performed. The mean-squared inputs were ad- 
justed equally during the first phase in order to provide a control 
environment as homogeneous as possible. The MS input was boosted 
by a factor of 4 on the lower left (LL) axis during the second 
phase in an attempt to force the subjects to change their scanning 
pattern. The subjects were instructed throughout this experiment 
to minimize the total MSE score (given as the sum of the four com- 
ponent MSE scores). 

In addition to the scanning experiments, a set of single-axis 
experiments was performed to provide the complete set of single- 
axis observation noise measurements required to test models of 
multi-axis control and scanning behavior. As a secondary benefit, 
these single-axis trials provided measurements which allowed us to 
determine the extent to which observation noise scales with input 
power. The high-input axis and one of the low-input axes (the LR 
axis) were each tracked individually under each of the four viewing 
conditions . 

The vehicle dynamics were K/s on all axes for the single- and 
multi-axis experiments, and all input spectra simulated a first- 
order noise process having a break frequency at 2 rad/sec. 
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Error and Control Scores 


a. Single-Axis Measures, — Average error variance scores ob- 
tained from the single-axis experiments are shown in Table B-12. 

The right column of this table shows the ratio of the high-input 
score to the low-input score. If the observation noise is basically 
multiplicative in nature, and if the controller is otherwise linear, 
the error score should scale with mean-squared input: in this case, 

by a factor of 4. 

Table B-12 shows that only the foveal score scaled approximately 
with input power. This score increased by a factor of 3.4, as 
opposed to a factor of 4 for the input. The score corresponding 
to foveal viewing with reference extrapolation increased by only 
a factor of about 2, and the remaining two scores corresponding to 
peripheral viewing with no reference extrapolation actually de- 
creased slightly with an increase in input power. (The decrease 
in the latter two scores was not statistically significant, whereas 
the foveal differences were significant at the 0.01 level and the 
peripheral-with-reference-extrapolation differences were significant 
at the 0.05 level.) These results suggest that the observation 
noise processes corresponding to peripheral viewing conditions do 
not scale with input and therefore cannot be ascribed solely to a 
multiplicative process acting on the displayed signal. This con- 
clusion is verified further on in this section through examination 
of the observation noise spectra. 

b. Multi-Axis Measures. — Mean-squared error and control scores 
obtained from the 4-axis experiments are presented in Table B-13. 
Scores are given for each of the four axes and for the "total score," 
defined as the sum of the scores across axes. Because of inter- 
subject differences, particularly with regard to scanning behavior, 
average performance levels for each subject are shown along with the 
average for all performance measures computed from the multi-axis data 
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TABLE B-12 


Effect of Mean-squared Input on Error Variance: Single-axis Tracking 


Viewing Conditions 

MS Input 

(deg/sec) 2 

HI/L0 Ratio 

0.22 

0.87 

Foveal 

.13 

.■44 

3.4 

16° periph, ref ext 

.38 

.71 

1.9 

16° periph, no ref ext 

1.0 

00 

CO 

GO 

OO 

22° periph, no ref ext 

1.3 

1 

1.2 

• 90 


MS error variance scores in deg 2 visual arc 
Average of 3 subjects, 1 run/subject 




TABLE B-13 


Effect of Mean-squared Input on Mean-squared Error and Mean-squared 
Control Scores 

Four Axes Tracked Simultaneously with Visual Scanning Allowed 



Homogeneous MSI 


Non-Homo gene ous 

MSI 

Sub j ect 

UL 

LL 

LR 

UR 

Total 

UL 

LL 

LR 

UR 

Total 


a. Mean-squared Error Scores (degrees 2 ) 


JF 

.54 

.63 

• 51 

.65 

no 

CM 

.65 

1.5 

.61 

1.0 

3-8 

DM 

• 57 

.75 

.60 

.43 

2.3 

. 60 

1.4 

.62 

• 54 

3-2 

GP 

.68 

• 77 

.78 

1.1 

3-4 

• 79 

1.5 

.89 

1.1 

4.3 

HS 

.64 

. 61 

.49 

.62 

2.4 

• 56 

1.2 

• 57 

• 56 

2.9 

Average 

.61 

.69 

• 59 

.70 

2.6 

.65 

1.4 

.67 

.81 

3-5 


b. Mean-squared Control Scores [(deg/sec) 2 ] 


JF 

6.2 

oo 

5-3 

6.6 

26 

7.6 

22 

5-8 

7.5 

43 

DM 

2.8 

4.5 

3.5 

3-4 

14 

3-5 

22 

3-5 

3-5 

33 

GP 

6.7 

7.8 

6.0 

13 

33 

6.5 

23 

5-4 

7.4 

42 

HS 

3.4 

5.8 

4.4 

7.1 

21 

2.7 

18 

3.9 

5-4 

30 

Average 

CO 

6.5 

4.8 

7.2 

24 

5.1 

22 

4.6 

5.9 

37 


Error scores is degrees 2 visual arc 
Average of 4 runs/subject 
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On the average, the subjects achieved about the same MSE 
scores on each of the four axes when the inputs were homogeneous. 

The largest spread in scores was between the UR and LR axes — a 
difference of about 17 percent. An analysis of variance of the 
scores, which is summarized in Table D-13 of Appendix D, showed 
that this difference was not statistically significant. Inter-axis 
differences among control scores was proportionally greater, with 
the UR score about 1.5 times the LR score. This difference was 
significant at the .001 level. 

Table D-13 shows that there were significant axis-by-subject 
interactions in these scores. We can observe this interaction 
from inspection of the data tabulated in Table 18. Subject DM, 
for example, achieved the lowest MSE score on the UR axis and the 
highest score on the LL axis, whereas subject JM achieved the 
highest score on the UR axis and the lowest on the LR axis. 

Inter-axis differences were much more pronounced in the non- 
homogeneous-input experiment. As expected, the largest score was 
obtained on the LL axis (the axis with the higher input power). 

The score on this axis was about twice the score that was achieved 
on this axis when the inputs were homogeneous. Table D-13 shows 
that the LL and UR MS error scores were both significantly different 
from the LR score, whereas the UL and LR scores did not differ sig- 
nificantly. The error scores revealed no significant axis-by-subject 

interactions . 

Tf 

We adopted the 0.05 significance level as the criterion level of 
"statistical significance"; i.e., we reject the null hypothesis 
if the significance level is numerically less than 0.05. 
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A large and statistically significant difference was found 
between the control scores on the LL and LR axes, with the LL 
score about 5 times the LR score. Because of significant axis- 
by-subject interactions manifested by the control scores, the 
remaining inter-axis differences failed the test of significance. 

The increase in the input power on the LL axis caused all MS 
error scores to increase on the average. The smallest increase 
was observed on the UL axis (a factor of about 1.07), and the 
largest increase occurred on the LL axis (a factor of about 2). 

The total score increased by about 1.3. Analysis of variance tests, 
summarized in Table D-14, show that the increases on all axes ex- 
cept the UL were statistically significant. The lack of significant 
axis-by-subject interactions indicates that these trends were con- 
sistent across subjects. 

Raising the input power had different effects on the MS control 
scores. The only significant increases were seen on the LL axis 
and on the total score. The LL score increased by a factor of 
about 3.^ (compared to a factor of 2 increase for the corresponding 
error score). The scores on the UL and LR axes remained about the 
same, on the average, and the UR score actually decreased to about 
0.8 times the homogeneous-input score. Significant axis-by-subject 
interactions were found on all but the LR axis. Thus, the changes 
in control scores caused by the increase of input power were more 
subject-dependent than the corresponding changes in error scores. 

The mean-squared error scores indicate that the subjects re- 
ceived relatively better information on the LL axis when the mean- 
squared input on that axis was increased from 2.2 to 8.7 (deg/sec) . 
Had the subjects tracked with the same efficiency on that axis for 
both input conditions, the MS error score would have increased by 
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a factor of 4, rather than the factor of about 2 that was observed 
experimentally. The relative improvement in tracking performance 
on the LL axis could result from increased foveal attention to that 
axis, from relatively improved observational characteristics, or 
from a combination of the two. Examination of the eye-movement 
data and observation noise spectra shows that improved observa- 
tional characteristics was the dominant factor. 

Vis u al Sc arm ing Behavior 

Fractional distributions of fixation time are shown in Table B-14 
along with the fractional distribution of mean-squared error (the 
latter defined as the mean-squared error on a given axis divided 
by the sum of the error scores on all four axes). We note first 
of all that the distribution of fixation time was markedly non- 
homogeneous even when the inputs were homogeneous. The UR display 
was fixated the most (43$ of the time) and the LL display the least 
(12$ of the time). The upper two displays as a group were fixated 
71$, whereas the lower two received only 29$ foveal attention. 

If the control task were truly homogeneous, then an uneven 
distribution of fixation times would result in an uneven distribu- 
tion of mean-squared error. Specifically, since the subjects 
fixated the upper displays 71$ of the time, we would expect most 
of the error to occur on the lower two displays. This was true 
only for subject DM. On the average, the total MSE score was dis- 
tributed nearly evenly among the four axes. On this basis we infer 
that the subjects must have received better visual information when 
fixating the upper displays than when fixating the lower ones. 

This conclusion is supported by the single-axis results, summarized 
in Table E-4, which show that the total score corresponding to fixa- 
tion of the upper displays was significantly lower than the score 
corresponding to fixation of the lower displays. 
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TABLE B-14 


Effect of Mean-squared Input on Fractional Distributions of Fix- 
ation Time and Mean-squared Error 


Sub j ect 

Homogeneous MSI 

Non-Homogeneous 

MSI 

UL 

LL 

LR 

UR 

UL 

LL 

LR 

UR 

a. Fractional Distribution of 

Fixation Time 




JF 

• 36 

.13 

• 15 

.37 

• 31 

.22 

.13 

.34 

DM 

.20 

.13 

.26 

.41 

.18 

.18 

.21 

.44 

GP 

• 34 

• 09 

.15 

.42 

• 39 

.11 

.06 

.44 

HS 

.23 

.12 

.13 

.52 

.38 

.08 

.09 

• 45 

Average 

.28 

.12 

.17 

.43 

• 32 

.15 

.12 

.42 

b. Fractional Distribution of 

Me an- squared Error 



JF 

.23 

.27 

.22 

.28 

.17 

.40 

. 16 

.26 

DM 

.24 

.32 

.26 

.18 

.19 

.45 

.20 

.16 

GP 

.21 

.23 

.23 

.34 

.18 

• 35 

.21 

. 26 

HS 

.27 

. 26 

.21 

. 26 

.19 

. 42 

.20 

.19 

Average 

. 24 

.27 

• 23 

.27 

. 18 

.40 

.19 

.22 
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Increasing the input power on the LL display had a negligible 
effect on the average scanning behavior. Three of the subjects 
spent slightly more time fixating the LL display, and one subject 
decreased his fixation on that axis. The net effect was to increase 
the fraction of fixation time on the LL axis from 0.12 to 0.15. 

This increased attention came entirely at the expense of the LR 
display, where fractional fixation time decreased from 0.17 to 
0.12. As we showed earlier, the increase in input power produced 
the expected trend in the distribution of mean-squared error scores. 
Table B-iMb shows that the fraction of total score attributable to 
the LL axis rose to 0.40, with about 20% of the total error occur- 
ring on each of the remaining axes . 

The failure of the change in input power to draw more foveal 
attention to the LL axis suggests that the subject receives rela- 
tively better peripheral information about that axis when the input 
power is increased. The behavior of the single-axis mean-squared 
error scores summarized in Table B-12 supports this conclusion, as 
does the analysis of the observation noise spectra presented later 
in this chapter. 

Mean observation times and fixation frequencies for each dis- 
play are given in Table B-15. Also shown is the overall scan fre- 
quency, which is defined as the number of transitions of the fixa- 
tion point per second and is equal to the sum of fixation frequen- 
cies over the four displays. The interaxis differences in mean 
observation time and fixation frequency followed the same trend, 
on the average, as the fractional allocation of fixation time for 
both variations of the experiment. For the homogeneous-input situ- 
ation the largest value of each of these three measured quantities 
was seen on the UR axis. The rank ordering of the remaining axes, 
from largest to smallest values, was UR, UL , LL, LR for all three 
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TABLE B-15 


Effect of Mean-squared Input on Mean Observation Time, Fixation 
Frequency, and Scanning Frequency 



Homogeneous MSI 

Non-Homogeneous 

MSI 

Sub j ect 

UL 

LL 

LR 

UR 

UL 

LL 

LR 

UR 


a. Mean Observation Time (sec) 


JF 

DM 

GP 

HS 

.80 
.47 
• 78 
.65 

.51 

.39 

.65 

.45 

.57 
.46 
1.00 
. 42 

1.02 

.69 

.86 

1.00 

.81 

.41 

.64 

1.58 


.68 
.48 
• 53 
1.02 

1.03 
• 70 
.62 
1.48 

Average 

.68 

.50 

.61 

.89 

.86 

.70 

.68 

.96 


b. Mean Fixation Frequency (looks/sec) 


JF 

DM 

GP 

HS 

.44 

.44 

.44 

.33 

.24 

.35 

.14 

.26 

.25 
• 56 
.15 
.29 

.36 
.64 
.48 
• 50 

.39 
.43 
. 61 
. 21 

.26 

.31 

.18 

.11 

. 20 
.44 
.11 
• 09 

.33 
.63 
• 70 
.30 

Average 

.41 

. 22 

.31 

• 50 

.41 

. 22 

. 21 

.49 


c. Scan Frequency (looks/sec) 


JF 

1.29 

1.18 

DM 

1.99 

1.81 

GP 

1.21 

1.60 

HS 

1.38 

0.74 | 

Average 

1.47 

1.33 
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quantities. The overall average scan frequency decreased from 
1.47 to 1.33 looks/sec when the LL input was increased. The reader 
should note that there were wide inter-subject variations in the 
measurements relating to scanning behavior, as shown in Tables B-14 
and B- 15 . 


Increase of the LL input power produced an increase in mean 
observation time on all axes. The largest relative increase oc- 
curred on the LL axis (from 0 . 50 to 0.70 sec — a factor of 1.4), 
whereas the lowest relative increases occurred on the UL and LR 
axes (about a factor of 1.1). The mean fixation frequencies were 
basically unchanged for three axes and decreased by about 1/3 on 
the LR axis . 

Obs erv at io n N ois e S pect r a and Describing Functions 

a. Single-Axis Measures. — We inferred from the single-axis 
mean-squared error scores that observation noise power was not 
linearly related to input power under peripheral viewing conditions . 
Examination of the observation noise spectra confirms this conclusion. 
Figure B-9 compares, for each viewing condition, the observation noise 

p 

spectra obtained with mean-squared inputs of 2.2 and 8.7 (deg/sec) . 
These spectra are un-normalized and have units of error power per 
rad/sec . 

If the observation noise power were to scale with input power, 
we would expect the spectrum corresponding to the larger input to 
be 6 dB above the spectrum corresponding to the lower input for each 
viewing condition. Figure B-9a shows that this relation held for 
foveal viewing. On the other hand. Figs. B-9b through B-9d, which 
show the peripheral observation noise spectra, reveal no consistent 
differences caused by the change in input power. It thus appears 
that the primary effect of placing a display in the periphery is to 
introduce an observational noise process that is fundamentally an 
additive process; i.e., one that does not scale with signal power. 
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The observation noise spectra are shown again in Pig. B-10 
to illustrate directly the differences between foveal and peripheral 
observation noise spectra. Spectra corresponding to an axis having 
the smaller mean-squared input are shown in Fig. B-lOa; spectra 
from the axis with the high input level are given in Fig. B-lOb. 

A comparison of these two sets of curves reveals that foveal-peri- 
pheral differences, especially at low frequencies, were substan- 
tially greater on the axis with the lower input. We interpret this 
result as indicating that the controller has relatively more to gain 
by looking at one of the low-input axes foveally than by fixating 
the high-input axis. (Equivalently, he has more to lose by observ- 
ing the low-input axis peripherally than by observing the high-input 
axis peripherally.) The fact that the subjects did not reduce their 
fractional fixation time on the LL axis when the MS input to that 
axis was increased indicates that the improved peripheral informa- 
tion on that axis was offset by the increased importance of that 
axis with respect to its contribution to the total performance 
score . 


The trend in the observation noise measurements was verified 
by the subjective impressions of the subjects. Without first in- 
forming them of the results of our eye-movement measurements, we 
asked two of the subjects whether or not they spent more time fix- 
ating the LL axis when the input was increased. They replied that 
they did not, because (a) they could see the signal on the LL dis- 
play well enough peripherally when the input was increased, and 
(b ) when they did fixate the LL display, they had difficulty esti- 
mating the signals on the remaining displays. 
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FIG . B- 10 EFFECT OF VIEWING CONDITIONS ON THE SINGLE-AXIS 
OBSERVATION NOISE SPECTRUM 

Average of 3 subjects, 1 tri al /sub ject 




The effects of viewing conditions on the pilot’s describing 
function are shown in Fig. B-ll. Because of the similarity of the 
describing functions corresponding to peripheral viewing of a given 
display, only the 22° peripheral describing function is compared 
with the foveal describing function for each of the two MSI condi- 
tions. Foveal-peripheral differences differ somewhat for the two 
input conditions. As we would expect from the trend in the observa- 
tion noise spectra, the overall difference between foveal and peri- 
pheral gain was slightly less on the high-input axis. On the other 
hand, foveal-peripheral differences in phase shift appear to be about 
the same on both axes over most of the measurement band. 

b. Multi-Axis Measures. — We have performed only a pre- 
liminary analysis of the observation noise spectra and human control- 
ler describing functions for the 4-axis scanning experiments. In 
Fig. B-12a we present a sample normalized observation noise spectrum 
which represents the average of the spectra measured on the LL and 
UR axes during the 4-axis scanning experiment with homogeneous inputs. 
Averages have been taken over subjects JF and HS. Single-axis ob- 
servation noise spectra corresponding to foveal and 22° peripheral 
viewing are shown for comparison. A similar single-axis, multi-axis 
comparison of the controller describing functions is shown in Fig.B-12b. 
The shape of the multi-axis observation noise spectrum appears to be 
similar to the single-axis foveal spectrum, with perhaps a somewhat 
lower break frequency, and has an asymptotic low-frequency level that 
is about midway between the foveal and peripheral levels. The multi- 
axis describing function, on the other hand, resembles very closely 
the single-axis peripheral results. Comparison of the multi-axis 
results to the single-axis foveal results reveals a consistent trend; 
that is, an increase in observation noise is accompanied by decrease 
in average controller gain. 
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FIG. B — 1 1 EFFECT OF VIEWING CONDITIONS ON THE SINGLE-AXIS 
HUMAN CONTROLLER'S DESCRIBING FUNCTION 
Average of 3 subjects, I trial /subject 
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SUMMARY OF RESULTS 


An initial experiment was performed to determine the relative 
merits of an error bar, reference bar-type of display presentation 
versus an error dot, reference circle presentation. Mean-squared 
error scores were found to be significantly less for the bar pres- 
entation, especially when the display was viewed peripherally. 
Consequently , the bar presentation was used throughout the remainder 
of the experimental program. 

A full set of single-axis trials was performed for each sub- 
ject. The rank ordering of task difficulty, as indicated by the 
mean-squared error score, was, from easiest to most difficult: 

(a) the foveal task, (b) 16° peripheral viewing with the ability 
to extrapolate a zero reference, (c) 16° viewing with no reference 
extrapolation possible, and (d) 22° viewing with no reference 
extrapolation. Overall, the performance score was less when the 
upper displays were fixated than when the lower displays were 
fixated. Indicating that better visual information could be obtained 
when the subject fixated the upper displays. Appreciable nonzero 
mean error was measured when peripheral displays were tracked with- 
out benefit of reference extrapolation, presumably because the 
baseline present on the peripheral display tended to disappear 
shortly after peripheral viewing was initiated. 

Changes in the controller’s equivalent normalized observation 
noise spectrum corresponded to changes in the error scores; the 
low-frequency portion of the spectrum increased as the task diffi- 
culty was increased. Controller gain decreased as the display was 
moved from the fovea to the periphery, and the phase lag at high 
frequencies increased. There were negligible differences among 
the describing functions corresponding to the three peripheral 
viewing conditions. 
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A set of 2-, 3-, and 4-axis experiments without visual scanning 
all showed task interference. The two-axis foveal-peripheral task 
showed an increase in total score of about 1.7 when the two axes 
were tracked simultaneously. Slightly more than half of this in- 
crease occurred on the peripheral axis. Observation noise increased 
about 3-4 dB on both axes, and both controller gains decreased by 
about 2-3 dB. Since the input levels were adjusted so that the 
foveal and peripheral tasks would contribute approximately equally 
to the total score, we conclude from these results that there is 
no fundamental difference between interference on a foveal task 
and interference on a peripheral task. The interference was sig- 
nificantly greater when the two axes had to be controlled by a 
single hand than when two hands were used. 

The three- and four-axis tasks also exhibited interference, 
with the largest percentage increase in MSE score per axis decreas- 
ing with the relative contribution of the component score to the 
total performance measure. (No attempt was made to equalize the 
component scores in these experiments.) Similarly, the observation 
noise level increased, again with the largest increase occurring 
on the axis which contributed least to the total performance score 
(i.e., the foveal axis). Controller gain also decreased, but the 
decrease was approximately the same on all axes. The apparent 
tendency of the subject to minimize the effects of interference on 
the more important tasks suggests a phenomenon akin to an optimal 
allocation of attention among the four axes. 

Two sets of four-axis experiments with visual scanning per- 
mitted were conducted: one with the mean-squared inputs the same 

on all axes and one with the lower-left (LL) mean-squared input 
quadrupled. Nonhomogeneous distribution of fixation time was ob- 
served under homogeneous as well as nonhomogeneous input conditions. 
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Even when the inputs were homogeneous, the subjects fixated the 
upper two displays collectively about 71? of the time; yet, the 
mean-squared error scores were about the same on each axis. This 
scanning behavior is consistent with the hypothesis, based on the 
single-axis MSE scores, that the subjects obtain better visual in- 
formation overall when fixating the upper displays than when fixa- 
ting the lower ones. 

Increasing the LL mean-squared input caused the error scores 
on all axes to increase, with the largest Increase occurring on 
the LL axis, as expected. The average scan frequency decreased 
slightly, with the result that mean observation times were increased 
from 10 to ^0 percent. The increase in input power did not, however, 
cause the subject to devote appreciably more time fixating the LL 
axis . 


A set of single-axis experiments was performed, one with the 
lower mean-squared input and one with the larger, to complete the 
set of measurements needed for a model of multi-axis control be- 
havior and also to Investigate the effects of input power on the 
observation noise spectrum. The resulting MSE scores, observation 
noise measurements, and controller describing functions all show 
that the subjects received better peripheral information when the 
MSI was increased. The relative improvement in peripheral informa- 
tion was apparently enough to offset the increase in importance of 
the LL task when the LL input was increased so that there was little 
change in the controller's scanning behavior. The failure of the 
peripheral observation noise levels to increase with Increasing MSI 
suggests that peripheral noise represents a process that is funda- 
mentally an additive process (unlike foveal observation noise, 
which appears to be basically multiplicative). 
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APPENDIX C. EFFECT OF VEHICLE DYNAMICS ON OBSERVATION NOISE RATIO 


p 

Our experiments with vehicle dynamics of K, K/s , and K/s con- 
sistently have yielded observation noise ratios on the order of 
-20 dB for foveal viewing of the display (see Refs. 9 and 6 and 
Section 3 of this report). The observation noise ratio of -26 dB 
obtained with the unstable dynamics K/s(s-X), (see Section *1) was 
inconsistent with these previous results. In an attempt to determ- 
ine why the lower observation noise ratio associated with the un- 
stable dynamics was so much smaller than expected, we conducted an 
experiment in which the same set of subjects tracked unstable and 
stable vehicle dynamics in three different experimental trials. 

The vehicle dynamics were of the form 



Experimental variables were: (a) the degree of vehicle instability 

X and (b) the point of application of the input forcing function. 

The subject was displayed a single quantity, the system error x(t), 
throughout this set of experiments. 

Diagrams of the three experimental tasks are shown in Fig. C-l; 
experimental parameters are tabulated in Table C-l. Task A was a 
replication of the 1-indicator display condition discussed in Sec- 
tion 4 except for a change in control sensitivity that is discussed 
below. Task C replicated a control situation studied previously 

p 

(Ref. 6 ) in which the vehicle dynamics were K/s and the input was 
applied as a disturbance to vehicle velocity, rather than to vehicle 
acceleration. This task is representative of those that yielded 
-20 dB observation noise ratios . Since tasks A and C differed two 
ways (instability and input injection point), we needed an additional 
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A. UNSTABLE VEHICLE, ACCELERATION DISTURBANCE 



B. STABLE VEHICLE, ACCELERATION DISTURBANCE 


I 



C. STABLE VEHICLE, VELOCITY DISTURBANCE 
FIG.C-1 DIAGRAMS OF THREE EXPERIMENTAL TASKS 
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TABLE C-l 


Parameter Values for the Second Experiment 


Parameter 

Experimental Condition 

A 

B 

C 

( arc-degrees/sec ) /volt ] 

.200 

.200 

.200 

2 

K 2 [ (degrees/sec ) /degree] 

2.50 

2.50 

2.50 

KjCdimensionless ] 

.157 

.240 

— 

K.J. [ de gre e s /volt ] 

— 

— 

.0200 

K u [ vo 1 1 s /newton ] 

5.64 

5.64 

5.64 

VVK 2 [( deg/sec 2 ) /newton] 

£.82 

2.82 

2.82 

p 

a^( volts ) 

8.72 

8.72 
L - 

C\J 

• 

CO 


Experimental Conditions : 

A. V=K/s(s-l), acceleration input 

2 

B. V=K/s , acceleration input 

C. V=K/s 2 , velocity input 
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intermediate task which would differ from each of these two in 
only one respect so that we could localize the cause of any per- 
formance differences that might be observed. Hence, we chose as 

p 

task B, a neutrally stable vehicle (K/s ) with the input applied 
as an acceleration disturbance. (We did not investigate the al- 
ternate intermediate condition of unstable dynamics with a velocity 
disturbance . ) 

Initially, we attempted to use the same control sensitivity 
that was used in the prior experiment with unstable control dynamics 
but the subjects complained that the system was not sufficiently 
sensitive for adequate control of condition C. Accordingly, the 
overall control sensitivity (the product of the parameters K ,K, , 

2 u X 

and K 2 ) was increased from 1.0 to 2.82 (deg/sec*; /newton. 

Input signals having spectral characteristics identical to 
those used in the prior experiment with unstable dynamics were used 
throughout this experiment. The effective input power (determined 
primarily by the input gain parameter Kj or Kj.) was varied from 
one condition to the next in order to maintain a consistent level 
of apparent task difficulty as measured by the error variance. 

In order to select appropriate values of input gain, we obtained 
first the principal model parameters (the relative control-rate 
weighting, the time delay, and the noise ratios) by matching the 
results of the 1-indicator experiment described in Section 4. 

Keeping these parameters constant, we simulated the experimental 
conditions for tasks B and C and determined the input gains that 
would yield error variance scores that were constant across the 
three experimental conditions. 

The same four subjects who participated in the prior unstable 
dynamics experiment participated in this validation experiment as 
well. Since tasks B and C were new to three of the subjects, most 



of the training was concentrated on these tasks. A few sessions 
with task A allowed the subjects to maintain their skill at 
tracking the unstable vehicle. An equal number of trials per 
condition was provided during experimentation (each subject per- 
formed each task four times), and the tasks were presented in a 
balanced order. 

EXPERIMENTAL RESULTS 

Optimal-control model behavior was matched to the average 
behavior of the subjects for each experimental condition. Two 
model parameters were held fixed across conditions: time delay 
was 0.2 sec, and the motor noise ratio was set at about -29.5 dB. 
The remaining parameters of control-rate weighting and observation 
noise ratio were selected for each condition to provide the best 
match to the measured variance scores and frequency-domain charac- 
teristics. The primary purpose of this exercise was to provide 
an estimate of the controllers' observation noise ratio. 

Model parameters are tabulated in Table C-2. The major param- 
eter of interest, the observation noise ratio, was essentially the 
same for the two acceleration-disturbance tasks. Ratios of -25 dB 
and -26 dB, respectively, were found for the unstable and stable 
vehicle tasks. This small difference was within the limits of 
precision of our model-matching procedure. Although a somewhat 
higher noise ratio, -23 dB, appeared to provide the best overall 
match to the velocity-disturbance data, a noise ratio of -26 dB 
provided almost just as good a match. Accordingly, model results 
using these two noise ratios are given for the velocity-disturbance 
task. 
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TABLE C-2 


Effect of Experimental Conditions on Model Parameters 


Task 

Vehicle 

Dynamics 

Type of 
Input 

# Relative 
u weighting 

Lag Factor 
(sec ) 

Time Delay 
(sec ) 

Noise 

Ratio 

Motor 

(dB) 

Obs 

(dB) 

A 

k/s ( s— 1 ) 

Acc . 

-4 

1.2 x 10 

.073 

.20 

- 29.2 

- 25.0 

B 

k/s 2 

Acc . 

_li 

1.2 x 10 

.079 

.20 

-29.5 

-26.0 

C (a) 

k/s 2 

Vel. 

0.6 x lO' 4 

.070 

.20 

-29.4 

- 23.0 

C(b) 

k/s 2 

Vel . 

0.6 x lO"^ 

.070 

.20 

-29.4 

-26.0 


Model scores are compared with average measured variance scores 
in Table C-3* (Average scores for individual subjects are given in 
Tables D-17 of Appendix D.) Matching of experimental results was 
very good for the two tasks in which the input was applied as an 
acceleration disturbance. Tables C-3a and C-3b show that all per- 
formance scores were matched to within 5 % (except for the control- 
rate score, for which the predicted score was about 30# too high). 
The performance scores obtained from the velocity-disturbance ex- 
periment were not matched so well. Of the two observation noise 
ratios tested in the model, a consistently better match to the 
scores was provided by the -23 dB ratio. 

Since our primary goal is to infer the subjects' average ob- 
servation noise ratios, we should place primary emphasis on the 

match between measured and predicted equivalent observation noise 
* 

spectra. Figures C-2 through C-4 show that the observation noise 


For a given control situation, the predicted observation noise 
spectrum depends primarily upon the noise parameters and much 
less strongly upon time delay and relative cost weightings. 

The variance scores, however, are influenced appreciably by all 
of the model parameters. 
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TABLE C-3 


Comparison of Measured and Predicted Variance Scores 


Data 

Observation 
Noise Ratio 
(dB) 

4 

(deg) 2 

«s 

p 

(deg/sec) 

■4 

2 

deg* 

4 

2 

newt 

4 

2 

(newt/sec ) 

a. Unstable vehicle. 

acceleration disturbance 



Exptl 

— 

.18 

2.2 

• 38 

9.7 

6.0 x 10 2 

Model 

-25.0 

.18 

2.2 

.38 ' 

9.8 

7.8 x 10 2 


b. Stable vehicle, acceleration disturbance 


Exptl 

— 

.19 

2.1 

.3* 

10 

5.9 x 10 2 

Model 

-26.0 

.18 

2.2 

.35 

10 

7.3 x 10 2 


c. Stable vehicle, velocity disturbance 


Exptl 

— — — 

• 30 

5.1 

.98 

18 

1.4 x 10 3 

Model (a) 

-23.0 

.27 

3.9 

.70 

12 

1.2 x 10 3 

Model (b) 

-26.0 

.22 

3.6 

.66 

11 

1.1 x 10 3 


Average of k subjects, 4 trials/subject 
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spectra, as well as the controller describing functions, were 
matched very well for the two experimental tasks in which the 
input was applied as a disturbance to vehicle acceleration. 

A reasonably good match was also obtained for the frequency- 
domain results of the velocity-disturbance experiment. Figure 
C-4a shows that good matches to the observation noise spectra 
were provided by the two noise ratios tested in the model; better 
mid-frequency results were obtained by the lower noise ratio 
(-26 dB) at the expense of a less good match at high frequencies. 

On the basis of these results we conclude that the subjects' 
equivalent observation noise ratios were substantially the same 
for the three tasks investigated in this experiment and consider- 
ably lower than the nominal values of -20 dB obtained for the ob- 
servation noise ratios in most of our earlier results. The unex- 
pectedly low noise ratios measured in our prior experiment with 
unstable dynamics, therefore, did not result from a direct depend- 
ency of noise ratio on vehicle dynamics. Moreover, the low noise 
ratios did not result from a dependence on input characteristics, 
although there is some indication that the velocity disturbance 
led to higher noise ratios. 

The simplest explanation for the improved performance of the 
subjects in this experiment is simply that they had learned to 
become more effective controllers as a result of their exposure 
to the unstable dynamics that were employed in this and in the 
prior experiment. With the unstable dynamics, the error variance 
was considerably more sensitive to observation noise than with 
the stable dynamics. As a result, the payoff from improving the 
noise ratio was appreciable and we postulate that the subjects 
learned to effect such an improvement. Once having managed a 
reduction in noise ratio, the subjects were apparently able to 
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transfer the low noise ratio to the other control tasks. 

In Figure C-5 is plotted the error variance as a function of 
observation noise ratio for the three experimental conditions in- 
vestigated in this experiment. The optimal-control model was used 
to predict the relationship between error variance and observation 
noise ratio. Observation noise ratio was varied between -26 dB and 
-20 dB; the remaining model parameters were selected from Table C-2. 

Predicted error variance was much more sensitive to observa- 
tion noise ratio when the vehicle dynamics were unstable (and the 

input applied as an acceleration disturbance) than when the vehicle 

2 

dynamics were K/s and the input was applied as a velocity disturb- 
ance. An intermediate sensitivity was observed for the stable- 
vehicle, acceleration-disturbance task. .For the velocity-disturb- 
ance task, a reduction of noise ratio from -20 dB to -26 dB reduced 
the predicted error score by only 2 dB, whereas the same variation 
of noise ratio represented about a 6.5 dB variation of performance 
for the unstable vehicle task. In other words, reducing the noise 
ratio was almost three times as effective when the vehicle was un- 
stable. Hence, the subjects apparently found it worth the extra 
effort to reduce observation noise in this situation, but not in 
the control situations using stable vehicle dynamics that we in- 
vestigated in earlier experiments. 

SUMMARY AND DISCUSSION 

An experiment was performed to determine why the observation 
noise ratios observed in the single-axis, multivariable experiment 
with unstable dynamics were substantially lower than the -20 dB 
noise ratio found in earlier experiments. Three control tasks 
were studied: (a) the second-order, unstable-vehicle task k/s(s-A) 

p 

investigated in the prior experiment, (b) a K/s task with the 
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(deg ) 



-28 -26 -24 -22 -20 -18 

OBSERVATION NOISE RATIO (dB) 


FIG.C-5 EFFECT OF OBSERVATION NOISE RATIO ON 
PREDICTED ERROR VARIANCE SCORE 
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input applied as a disturbance to vehicle velocity, a control 

2 

situation also studied in an earlier experiment, and (c) a K/s 
task with an acceleration disturbance. By matching the output of 
the optimal-control model to the experimental data, we concluded 
that the noise ratios were not substantially different for the 
three tasks. We therefore ruled out the possibility of a direct 
functional relationship between noise ratio and control system 
parameters . 

The most likely explanation for the relatively low noise 

ratio is that training on the unstable dynamics provided very 

strong motivation for the subjects to reduce their observation 

noise. An investigation of model behavior showed that predicted 

error score was three times as sensitive to observation noise 

2 

ratio for the unstable-vehicle task than for the K/s task with 
the velocity input. Once trained to achieve a low noise level, 
the subjects apparently retained this ability when presented with 
the stable-vehicle tasks. 

Since the "minimum" observation noise ratio that the pilot 
is either willing or able to achieve depends on task parameters 
and training procedures, we must now face the question of how to 
select the appropriate noise ratio when we wish to obtain model 
predictions for a control situation we have not previously in- 
vestigated. If we wish to study task interference, what ratio 
should correspond to "full capacity"? We have no simple answer 
to these questions. Clearly, the equivalent observation noise 
ratio is related to how well, and in what manner, the subject is 
trained. We would have trouble, then, predicting the absolute 
limit of performance attainable by a pilot in a given control 
situation. 
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Rather than concern ourselves with the minimum attainable 
noise ratio, we suspect that a more relevant approach to manual 
control problems in general is to determine the maximum permis- 
sible noise ratio that the pilot can allow himself without ex- 
ceeding performance specifications. By comparing the observation 
noise requirements of various tasks, we can determine the relative 
"demands" they make on the pilot. We have applied this approach 
to the problem of predicting pilot workload in Section 5 of this 
report . 
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TABLES OF PERFORMANCE MEASURES 



TABLE D-l 


Effect of Display Format on Mean-Squared Error Scores 


Subject 

Mode of 
Viewing 

Display 

Format 

Axis Tracked 
Left Right Average 

JF 

Foveal 

bar 

dot 

.0778 

.0750 

.0793 

.0834 

.0786 

.0792 

Peripheral 

bar 

dot 

.300 

.390 

.790 

.970 

.545 

.680 

DM 

Foveal 

bar 

dot 

.0994 

.125 

.0997 

.107 

.0996 

.116 

Peripheral 

bar 

dot 

.386 

.477 

.378 

.872 

.382 

.675 

GP 

Foveal 

bar 

dot 

.140 

.145 

.130 

.132 

.135 

.139 

Peripheral 

bar 

dot 

1.02 

.957 

.968 

1.09 

.994 

1.02 

HS 

Foveal 

bar 

dot 

.0869 

.103 

.0924 

.107 

.0897 

.105 

Peripheral 

bar 

dot 

.499 

.444 

.696 

1.17 

.597 

.807 


2 

MS error scores in degree visual arc. 
1 run per subject per condition. 
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Tables D-3 through D-7 contain a breakdown on the error and 
control scores for the single-axis tracking experiments reviewed 
in Appendix A. Table D-2 below contains a list of the variables 
represented in these tables. 


TABLE D-2 

List of Performance Measures Appearing in Tables D-3 - D-7 
(units refer to equivalent display deflection) 


Symbol 


X 2 

2 

mean-squared error in degree 

2 

2 

error variance in degree 


2 2 

input-correlated portion of a in degree 

A 

°xr 

2 2 

remnant-related portion of a x in degree 

2 2 
a /a 
xr x 

fractional remnant power (dimensionless ratio) 


fractional variational power (dimensionless ratio) 

< 

p 

variance of control effort in (degree/second) 

a ui 

2 2 

input-correlated portion of in (degree/second) 

■4 

2 2 

remnant-related portion of 0 u in (degree/second) 


fractional remnant power (dimensionless ratio) 


Note: Since mean-squared control effort and the variance of the 

control effort agreed to within 1% in almost all cases, we have 
not tabulated mean-squared control effort. 
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TABLE D-3 

Effect of Relative Display Location on Average Performance Measures 


Relative 

Display 

Location 


Axis Display 
Tracked Fixated 


UL 

UL 

.117 

mm 

.0863 

.0282 

.981 

.245 

4.18 

3.18 

1.00 

.230 

LL 

LL 

.140 

HEShI 

.0928 

.0430 

.974 

.267 

4.69 

3.19 

1.50 

.270 

LR 

LR 

.134 

.134 

.104 

• 0292 

.994 

.213 

3.89 

3*11 : 

0.783 

.199 

UR 

UR 

i 

.133 

.132 

.0985 

.0347 

.995 

.240 

USB 

2.99 

1.08 



AVG 

.131 

.129 

.0954 

.0339 

.986 

.241 

WBM 

3.12 

1.09 

.211 


Foveal 


16° Peripheral 

Reference 

Extrapolation 


UL 

LL 

.545 

.516 

.213 

.303 

.950 

.569 

5.63 

2.49 

3.13 

.493 

LL 

LR 

- 

.321 

.317 

.168 

.149 

.986 

.469 

5.41 

2.78 

2.63 

.429 

LR 

UR 

.445 

.432 

.223 

.208 

.979 

.447 

5.44 

2.53 

2.91 

.469 

UR 

UL 

.394 

.385 


• 201 

.962 

.497 

5.59 

2.65 

2.94 

.471 


AVG 

.426 

.413 

.197 

.215 

.969 

.495 

5.52 

2.61 

2.90 

.465 


16° Peripheral 
No Reference 
Extrapolation 


UL 

UR 

.727 

.613 

CVI 

o\ 

I — 1 

.421 

.865 

.675 

5.93 

2.70 

3.23 

.497 

LL 

UL 

.626 

.553 

1 

.371 

.894 

.666 

6.40 

2.62 

3.80 

.552 

LR 

LL 

1.26 

1.08 

H9 

.794 

.886 

• 721 

6.22 

2.64 

3.71 

.565 

UR 

LR 

1.53 

.983 

.208 

.775 

.778 

.728 

6.03 

2.61 

3.42 

.528 


AVG 

1.04 

.807 

.216 

.590 

.856 

.697 

| 6.14 

2.64 

3.54 

.535 


22° Peripheral 
No Reference 
Extrapolation 



rH 

CO 

1 — S 

.221 

1.09 

.784 

.205 

.580 

1.33 

.363 

.965 


277 1.08 


.813 

6.30 

2.29 

4.01 

.628 

r— I 
■=r 
0- 

7.63 

2.57 

5.06 

.625 

.739 

7.72 

2.77 

4.94 

.630 

.789 

7.29 

2,. 62 

4.70 

.629 

.770 

7.23 

2.56 

4.68 

.628 


Average of M subjects, 1 run per subject 




































































































































































































TABLE D-4 


Effect of Relative Display Location on Performance Measures : Control of UL Display Only 


Relative 

Display 

Location 

Display 

Fixated 

Subject 

X 2 

< 

°xi 

a 2 

xr 

± 

X 2 

<4 

4 

4 

4 

4 

4 

4 

Poveal 

UL 

JF 

.0804 

.0791 

.0549 

.0242 

.984 

.306 

5 * 22 

3.77 

1.45 

.277 

DM 

.119 

.119 

.0983 

.0207 

1.000 

.174 

3.47 

2.90 

0.572 

.165 

GP 

>150 

.147 

.0978 

.0491 

.980 

.335 

4.59 

3.12 

1.17 

.321 

HS 

.118 

.113 

.0942 

.0188 

.958 

.166 

3.45 

2.91 

0.544 

.157 

AVG 

.117 

.115 

.0863 

.0282 

.981 

.245 

4.18 

3.18 

1.00 

.230 

16° Peripheral 

Reference 

Extrapolation 

LL 












JP 

.254 

.241 

.101 

.140 

.949 

.582 

5.37 

3.05 

2.32 

.432 

DM 

.396 

.383 

.210 

.173 

.967 

.451 

4.13 

2.61 

1.51 

.369 

GP 

.847 

.800 

.271 

.529 

.945 

.661 

9.55 

2.26 

7.29 

.763 

HS 

.681 

.638 

.268 

.370 

.937 

.580 

3.45 

2.05 

1.40 

.407 

AVG 

.545 

.516 

.213 

.303 

.950 

.569 

5.63 

2.49 

3.13 

.493 

16° Peripheral 
No Reference 
Extrapolation 

UR 


WfSTSW 

ggjgggiB 

gum 





JfffPff 

BMHH 


JF 

.505 

.500 

.109 

.391 

.990 

. 782 

6.56 

3.27 

3.30 

.502 

DM 

.607 

.458 

.243 

.215 

.755 

.470 

3.65 

2.36 

1.29 

.354 

GP 

1.07 

.766 

.238 

.527 

.716 

.689 

9.27 

2.75 

6.52 

.703 

HS 

.727 

.726 

.176 

.549 

.999 

.757 

■EB 

2.41 

1.80 

.427 

AVG 

.727 

.613 

.192 

.421 

.865 

.675 

sa 

2.70 

3.23 

.497 

22° Peripheral 
No Reference 
Extrapolation 

LR 












mm 

1.03 

mam 

msm 

.874 

.981 

.866 

6.89 

2.62 

4.27 

.620 

msm 

1.07 

MtTM 

mm 

.523 

.726 

.673 

4.97 

2.47 

2.50 

.504 

GP 

2.83 

| 

mm 

1.29 

.541 

.846 

7.50 

2.20 

5.30 

.707 

HS 

1.95 


.258 

1.69 

.995 

.867 

5.84 

1.86 

3.98 

.681 

AVG 

mm 


.221 

1.09 

.811 

.813 

6.30 

2.29 

4.01 

.628 


























































































TABLE D-5 

Effect of Relative Display Location on Performance Measures: Control of LL Display Only 

I I ^ I I I 2 I 2 I : 


Relative 

Display 

Location 

Foveal 


Display 

fixated Subject 


.0770 >0768 
.110 .110 


.0589 .0179 .997 

.09*16 I .015*1 1.000 


.233 4.73 ; 3.73 

.1*10 j 3.51 j 3.0*1 

88 I 6.92 i 2.98 



16° Peripheral 

JF 

.200 

.194 

.0927 

.101 

.970 

Reference 

Extrapolation 

DM 

.327 

.327 

.210 

.117 

1.000 


5.67 

3 

3.77 

i 2 


1.00 
.*172 
.39*1 
585*1 
SO 













TABLE D-6 

Effect of Relative Display Location on Performance Measures: Control of LR Display Only 


Relative 

Display 

Location 

Display 

Fixated 

Subject 


a 2 

X 

°xi 

a 2 

xr 

a 2 

X 

5? 

a 2 

xr 

X 

a 2 

u 

°ul 

a 2 

ur 

a 2 

ur 

u 

Foveal 

LR 

JF 

.0920 

.0920 

.0739 

.0182 

.994 

.197 

4.43 

3.68 

.752 

.170 

DM 

.131 

.131 

.113 

.0179 

1.000 

.137 

3.27 

2.92 

.350 

.107 

GP 

.152 

.152 

.119 

.0331 

1.000 

.218 

3.96 

3.04 

.919 

.232 

HS 

.162 

.159 

.111 

.0477 

.981 

.300 

3.90 

2.79 

1.11 

.285 

AVG 

.134 

. 13^ 

.104 

.0292 

.994 

.213 

3.89 

3.11 

.783 

.199 

16° Peripheral 

Reference 

Extrapolation 

UR 












JF 

.207 

.206 

.113 

.0932 

.995 

.453 

5.35 

- 

3.20 

2.11 

.395 

DM 

.296 

.295 

.224 

.0706 

.997 

.240 

3.30 

2.49 

.810 

.245 

GP 

.618 

.617 

.287 

.330 

.998 

.535 

9.32 

2.52 

6.80 

.730 

HS 

.658 

.608 

.268 

.340 

.924 

- 

• 559 

3.80 

1.88 

1.92 

.505 

AVG 

. 445 

.432 

.223 

.208 

.979 

.447 

5.44 

2.53 

2.91 

.469 

16° Peripheral 
No Reference 
Extrapolation 

LL 












JF 

.596 

.524 

.142 

.382 

.879 

.729 

5.77 

2.91 


■a 

DM 

.571 

.563 

.211 

.352 



mm 

2.90 


■taai 

GP 

1.85 

1.79 

.507 

1.28 



■ 

2.02 


■S3 

HS 

2'. 0 3 

1.44 

.272 

1.16 




2.73 

2.55 




Esn 

.283 

.794 

.886 

.721 

6.22 

2.64 

mm 

.565 

22° Peripheral 
No Reference 
Extrapolation 

UL 












JF 

1.73 


.106 

1.27 


IBgg 



\mm 


DM 

.857 

.712 







insn 


GP 

1.44 


.343 

1.09 


.760 

11.2 

3.29 

7.85 

.706 

HS 

1.80 



.986 

.994 

.550 

5.51 

2.24 

3.27 

.594 

AVG 

1.46 



.965 

.903 

.739 

7.72 

llfll 













TABLE D-7 

Effect of Relative Display Location on Performance Measures: Control of UR Display Only 





Relative 

Display 

Location 

Display 

Fixated 

Subject 


Foveal 



.0139 1.000 

.0767 T995 

.0314 1.000 


16° Peripheral 

Reference 

Extrapolation 



.128 .887 
■0657 .963 

.390 .998 

.222 1.000 


16° Peripheral 


JF 

.579 

.579 

.110 

.469 

1.000 

No Reference 
Extrapolation 


DM 

.524 

.461 

.237 

.224 

.880 


LR 

GP 

13-50 

11.82 

.173 

1.65 

1 .520 


22° Peripheral 
No Reference 
Extrapolation 


AVG 1.95 1.35 


W 2.14 



2.51 

3.08 

.561 


IKSSiM 

6.45 

.748 

1 


5.89 

.684 


2.62 

4.70 

.629 




















TABLE D-8 


Effect of Fixation Point on Total Mean-Squared 
Error Score: Single-Axis Tracking 


Subject 

Display 

Fixated 

UL 

LL 

LR 

UR 

JF 

2.43 

1.57 

1.89 

1.57 

DM 

1.81 

2.37 

2.06 

.3-39 

GP 

3.01 

6.08 

6.27 

2.97 

HS 

3.10 

5.55 

3.92 

2.67 

Average 

2.59 

3.89 

i 

3.53 

2.65 


2 

MS Error in degrees visual arc 
One score per subject 
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TABLE D-9 


Effect of Viewing Conditions on Average 
Normalized Observation Noise Spectrum 



Average of M subjects, 4 runs each 

- 1 unit of normalized power per rad/sec 


0 dB 


c+ rr 



TABLE D-10 


Effect of Viewing Conditions on the Average Human Controller Describing Function 

Gain in dB Phase Shift in Degrees 

Measurement I I I I ” 


Frequency 1 6° Periph 16° Periph 22° Periph 16° Periph 16° Periph 22° Periph 

(rad/sec) Foveal Ref Ext No Ref Ext No Ref Ext Foveal Ref Ext No Ref Ext No Ref Ext 



Average of ^ subjects, 4 runs each 
0 dB = 1 degree/second per degree 










TABLE D-ll 


Effect of Number of Axes Tracked on Mean-Squared 
Error Scores : One Foveal and One Peripheral Display 



1 

Foveal 

Peripheral 

Total 

Score 

Subject 

No. Hands 

1-axis 

2-axis 

1-axis 

2-axis 

1-axis 

2-axis 


1 

.165 

.368 

.206 

.430 

.371 

.798 

JF 

2 

.200 

.290 

.164 

.343 

.365 

.633 


AVG 

.183 

.329 

.185 

.386 

.368 

.716 


1 

.274 

.420 

.254 

.628 

.528 

1.048 

DM 

2 

.313 

.393 

.233 

.412 

.546 

.805 


AVG 

.294 

.406 

.243 

.520 

.537 

.927 


1 

.454 

.819 

.244 

.444 

.698 

1.262 

GP 

2 

.469 

.419 

.383 

.612 

.852 

1.032 


AVG 

.462 

.619 

.313 

.528 

.775 

1.147 


1 

.291 

.618 

.181 

.437 

.471 

1.060 

HS 

2 

.402 

.670 

.171 

.316 

.574 

.989 


AVG 

.347 

.644 

.176 

.377 

.523 

1.024 


1 

.296 

• 556 

.221 

.485 

.517 

1.042 

AVG 

2 

.346 

.443 

.238 

.421 

.584 

.865 


AVG 

.321 

.500 

.230 

.453 

.551 

.953 


2 

MS error scores in degrees visual arc 
Average of 2 runs/subject 
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TABLE D-12 

Effect of Number of Axes Tracked on Mean-Squared Error Scores: 
One Foveal and Three Peripheral Displays 


Subject 

Foveal 

16° Peripheral 
Ref Ext 

16° Peripheral 
No Ref. Ext 

22° Peripheral 
No Ref. Ext 

1-axis 

3-axis 

4-axis 

1-axis 

3-axis 

4-axis 

1-axis 

3-axis 

4-axis 

1-axis 

3-axis 

4-axis 

JF 

.0691 

— 

.288 

.180 

.933 

1.10 

.221 

.525 

.739 

.837 

1.79 

1.67 

DM 

.119 

— 

.190 

.228 

.388 

.552 

.472 

1.40 

1.47 

.956 

1.43 

1.85 

GP 

.125 

— 

.392 

.374 

1.54 

1.63 

.549 

1.30 

2.19 

1.98 

2.04 

2.66 

HS 

.mo 

— 

.343 

.302 

.745 

.873 

.782 

1.84 

1.86 

1.12 

2.57 

2.51 

AVG 

.113 

— 

.303 

.271 

.902 

1.04 

.506 

1.27 

1.57 

1.22 

1.88 

2.17 


p 

MS error scores in degrees visual arc 


Average of 2 runs/subject: 1-axis and 4-axis 

Average of 4 runs/subject: 3-axis 



TABLE D-13 


Summary of Analysis of Variance of Mean-Squared Error 
and Mean-Squared Control Scores for 4-axis Scanning Experiments : 

Inter-Axis Differences 



Homogeneous 

Input 

Non-Homogeneous Input 

Effect 

UL LL 

UR 

UL LL UR 


a. Mean-Squared Error 


Axis 

Subject 

Axis X Subject .01 

.001 

.05 .001 

.01 

.001 

.001 

.001 

t 

. Mean-Squared Control 


Axis 

.001 

.001 

— 

Subject .05 

.001 

— 

.05 

Axis X Subject .05 

.001 .05 

.05 

.05 


Significance level shown for the difference between the score on 
the LR axis and the score on one of the remaining axes. 
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TABLE D-14 


Summary of Analysis of Variance of Mean-Squared Error 
and Mean-Squared Control Scores for 4-axis Scanning Experiments 


Effect 

I 

UL 

nter-Ii 

LL 

iput Dii 
Axis 

LR 

'ferences 

UR 

5 

Total 



a. Mean-Squared Error 


Axis 

Subject 

Axis X Subject 

1 • 1 

1 O 1 

1 M 1 

.001 

.05 

.05 

.001 

.01 

.001 

.001 

.001 


t 

. Mean-Squared Control 

Axis 

— 

.01 

— 

— 

Lf\ 

o 

• 

Subject 

.05 

— 

.001 

— 

— 

Axis X Subject 

.05 

.05 

— 

.001 

.01 


Significance level shown for the change in score on a given axis 
caused by a change in the MS Input on the LL Axis. 
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TABLE D-15 


Effect of Display Conditions on Average Variance Scores: 
Single-Axis, Multivariable Task 



2 2 

0 2 

a 2 

a? 


X X 

a y 

% 

a u 

Sub j ect 

p p 

deg (deg/sec) 

(deg) 2 

2 

newton 

2 

(n/sec ) 


a. Y-Display Off 


KG 

.221 1.40 

.260 

37.0 

1.63 x 10 

WM 

.193 2.02 

.353 

61.5 

2.49 x 10 

JM 

.255 1.66 

.305 

42.0 

1.66 x 10 

WR 

.260 2.39 

.423 

58.2 

2.16 x 10 

Average 

.232 1.87 

.335 

49.7 

1.98 x 10 

Geom. Avg. 

.231 1.83 

.330 

48.6 

1.95 x 10 


b. Y-Display On 


KG 

.110 1.00 

.180 

36.0 

1.95 x 10 3 

WM 

.159 1.66 

.250 

51.2 

on 

o 

rH 

X 

G\ 

i — 1 

JM 

.151 1.06 

.192 

34.2 

1.59 x 10 3 

WR 

.163 1.48 

.263 

43.2 

1.86 x 10 3 

Average 

.146 1.30 

.231 

41.1 

1.84 x 10 3 

Geom. Avg . 

.144 1.27 

.227 

40.6 

1.83 x 10 3 


c. Ratio: (Y-Display On)/(Y-Display Off) 


KG 

.498 .714 

.692 

.973 

1.20 x 10 3 

WM 

.324 .822 

.822 

m 

on 

00 

.791 x 10 3 

JM 

•592 .639 

.630 

.819 

.958 x 10 3 

WR 

.627 .619 

.622 

.792 

.861 x 10 3 

Average 

.635 .698 

.691 

.841 

.952 x 10 3 






TABLE D-16 


Summary of Analysis of Variance of System Error 
Variance Scores: Single-Axis, Multivariable Task 


Effect 

Significance Level 


* ** 

No. of Indicators 

.05 .001 

Subject 

— 

Subject X Number 

.05 


* 

Tested against "interaction" variance 

* » 

Tested against "experimental error" variance 
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TABLE D-17 


Effect of Task Parameters on Average Variance Scores : 
Single-Axis Task, Second-Order Dynamics 



! C\J X 
1 b 

c? 

a 2 

2 

a? 


°x 

y 

°u 

a u 

Subject 

deg 2 

p 

(deg/sec) 

deg 2 

2 

newton 

2 

(n/sec) 


a. Unstable Vehicle Dynamics, Acceleration Disturbance 


KG 

.162 

1.45 

.258 

6.14 

4.29 x 10 2 

WM 

.168 

2.90 

.493 

16 . 1 

11.2 x 10 2 

JM 

.164 

1.88 

.328 

8.19 

4.27 x 10 2 

WR 

.253 

2.75 

.480 

10.9 

6.19 x 10 2 

Average 

.187 

2.24 

.390 

10.3 

6.49 x 10 2 

Geom. Avg. 

.. 

.183 

2.16 

• 376 

9.69 

5.97 x 10 2 

b. Stable 

Vehicle Dynamics, Acceleration Disturbance 

KG 

.196 

1.67 

.267 

7.62 

4.77 x 10 2 

WM 

.179 

2.41 

• 385 

13.5 

8.25 x 10 2 

JM 

.169 

1.97 

.315 

9.62 

4.69 x 10 2 

WR 

.237 

2.41 

• 385 

11.2 

6.62 x 10 2 

Average 

.195 

2.11 

.338 

10.5 

6.08 x 10 2 

Geom. Avg. 

.194 

2.09 

.335 

10.2 

5.91 x 10 2 


c. Stable Vehicle Dynamics, Velocity Disturbance 


KG 

.278 

3.72 

.737 

10.0 

9.37 x 10 2 

WM 

.312 

7.15 

1.36 

38.2 

33.9 x 10 2 

JM 

.285 

5.12 


17.3 

9.94 x 10 2 

WR 

.330 

CM 

CO 

• 

-=r 

.930 

15.7 

11.9 x 10 2 

Average 

. 301 

5.20 

1.01 

20.3 

16.3 x 10 2 

Geom. Avg. 

.300 

5.07 

.982 

17.9 

13.9 x 10 
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